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INTRODUCTORY REMARKS 


A. S. Barr 
University of Wisconsin 


We are offering herewith another* in a 
series of studies of teaching ability. The pur- 
pose of the present monograph is to present 
data on the prediction of teaching efficiency. 
The researches here reported are based upon 
an intensive study of two groups of individ- 
uals, one of 58 and the other of 65 cases. The 
data were supplied by the Teacher Personnel 
Research Committee,** School of Education, 
University of Wisconsin. 

Many problems confront those who would 
anticipate the results of selection, training, 
and placement programs. Many programs 
have been put into operation, but few have 
been subjected to systematic evaluation. The 
research here reported present data on the 
results of three follow-up studies conducted 
at the University of Wisconsin to ascertain 
the value of certain selection, training, and 
placement practices. 

*A. S. Barr and others, The Measurement of Teaching 
= (Madison, Wisconsin: Dembar Publications, Inc., 


membership of this committee has shifted from time 
to _- , A. following a ws i. to the collection 2 
5. y, 
7 Glen Eye, Kai Rem tbe Little, ‘Camella 
N. Oe: C. Pooley, John W. N. 
, ty, T. L. Torgerson, and M. H. Willing 


In the studies here presented the predictive 
value of many different types of data is con- 
sidered. These data fall roughly into four 
groups: (1) data collected with reference to 
each individual as an entering freshman; 
(2) academic grades and records; (3) results 
of especially administered tests; and (4) a 
large amount of subjective data. 

We were interested in this investigation in 
answers to questions such as: 

1. Can teaching efficiency be predicted? 
2. Can efficiency be predicted as early as the 
freshman year? 3. Is achievement in various 
professional and academic course work indica- 
tive of success in the field? 4. Of what rela- 
tive value have subjective and objective data 
in predicting teaching efficiency? 5. What 
conditions favor valid and reliable prediction? 

Of the three studies to follow, the first pre- 
sents an intense study of the cases for which 
the data were most complete. The second 
study concerns itself with the relative merits 
of subjective and objective data; the third 
presents the results of a study of cases for 
which the data are less complete. 





THE PREDICTION OF TEACHING EFFICIENCY 


Leo Josepu Lins* 
University of Detroit 


SECTION I 
THE PROBLEM 


I.1. INTRODUCTION 


An important problem in the area of pre- 
service teacher education is that of choosing 
from prospective candidates those most likely 
to be an asset to the profession. Selection and 
guidance as well as education are important 
functions of teacher training institutions. In 
order that these functions might be carried 
out to a higher degree of perfection, it is nec- 
essary not only to measure teaching efficiency 
but also to analyze the types of educative 
experiences that contribute to efficiency. On 
the basis of such analyses, it should be pos- 
sible to predict, better than has ordinarily 
been done, the efficiency of persons desirous 
of becoming teachers. 


Many persons have been interested in and 
have tried to measure teaching efficiency. 
However, until recently, subjective estimates 
have been used as the chief criteria of success. 
With the advent of and emphasis upon objec- 
tive measurement, attention has been focused 
upon the determination of teaching efficiency 
through objective techniques. This has been 
a difficult task because of the complexity of 
the teaching act. To arrive at objectivity, it 
is necessary to analyze and define the con- 
stituents of teaching efficiency with much 
more care than is usually the case. 


This investigation is concerned with the 
prediction of the teaching efficiency of pro- 
spective School of Education graduates in 
terms of measures collectable during the 
period of institutional preparation. It is 
hoped that two major contributions will re- 
sult from this investigation: first, that assist- 
ance may be given in the evaluation of the 
educative experiences commonly employed in 
the education of teachers, and second, that 
information may be provided for use in de- 


* The ote gratefully ep: the assistance rendered 
by Dr. S. Barr, Professor Education, University of 
i Ae thesis advisor, as members of the Teacher 
Personnel Research Committee for aid received. 


veloping a more constructive program of 
selecting and guiding prospective teacher 
candidates. 


I.2. STATEMENT OF THE PROBLEM 


The central purpose of the investigation 
herein reported is to determine whether there 
is anything in the pre-service records and 
make-up of persons being prepared for teach- 
ing that can be discovered, defined, and em- 
ployed for predicting, first, whether or not a 
person will be admitted to the School of Edu- 
cation at the beginning of the junior year of 
institutional training, and for predicting, sec- 
ond, the subsequent teaching efficiency of per- 
sons graduated with the University Teacher’s 
Certificate. 

More specifically, this study attempts to 
answer the following questions: 

1. In terms of pre-university records and 
tests administered during Freshman Orienta- 
tion Week at the University of Wisconsin, 
can accurate predictions be made as to whom 
will be granted admission to the School of 
Education at the beginning of the junior year 
of university work? 

2. Can the teaching effectiveness of grad- 
uates of the School of Education, University 
of Wisconsin, be predicted from facts col- 
lected prior to entrance upon their teaching 
responsibilities? 

a. How valid are certain measures, taken 
alone or in combinations, as factors in 
the prediction of teaching efficiency? 

. Are comparable results secured from the 
three criteria of teaching efficiency, 
namely supervisory ratings, pupil eval- 
uations of the teacher, and pupil change? 

. Would more accurate placement with 
knowledge of the teaching situation im- 
prove the quality of teaching? 


3. Do answers to the aforementioned ques- 
tions contain guides for the recruitment, 
selection, guidance, education, arid placement 
of persons to be educated for teaching at the 
University of Wisconsin? 
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SECTION II 


GENERAL PROCEDURE OF 
INVESTIGATION 


II.1. DESIGN OF THE STUDY 


An attempt is made in this investigation to 
discover important antecedents to teaching 
efficiency. To this end, a considerable amount 
of data was collected relative to each indi- 
vidual up to the time of his being graduated; 
subsequently, evaluations were made of each 
individual’s teaching performance during the 
first year of teaching after being graduated. 

The students chosen for special study were 
those entering the University of Wisconsin in 
September 1939. Five hundred forty-five stu- 
dents expressed interest in teaching as their 
first, second, or third choice of occupation on 
the University’s Application for Admission 
blank (Appendix A. 1).* All data which ap- 
peared of value concerning the above indi- 
viduals were transferred from the admission 
blanks to the Teacher Personnel Tabulation 
Sheet (Appendix A. 2).* 

Twenty-nine cases were eliminated, because 
of insufficient data, leaving 546: 175 men and 
371 women. Of these, 131 were not residents 
of Wisconsin and were, therefore, dropped 
from the study. Three hundred forty-six of 
the 415 still under consideration enrolled at 
the University. Of this number, 204 expressed 
teaching as their first choice of occupation, 
39 expressed teaching as their second choice, 
and 28 as their third choice. 

Prediction Study One consists of persons 
who expressed teaching as their first choice 
of occupation, who were graduates of Wiscon- 
sin high schools, and who entered the Univer- 
sity of Wisconsin in September 1939. Of the 
204 persons (59 men and 145 women) meet- 
ing these requirements, 119 enrolled for the 
junior year and 75 were graduated. Fifty-two 
of these graduated with the University Teach- 
er’s Certificate and 23 with degrees in other 
fields. 

The above data do not include persons ad- 
mitted to the School of Education who did 
not express teaching as their first choice of 
occupation in entering the University nor 
those admitted as transfers from other col- 
leges and universities. 

All in all, 260 persons were admitted to the 
School of Education in 1941. Of these, 223 
were graduated and received the University 

* See original thesis on file, Library, University of Wisconsin. 
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Teacher’s Certificate of whom 116 accepted 
teaching assignments for the fall semester of 
1943. Fifty-eight of these, all women, teach- 
ing in the state of Wisconsin, for whom the 
data were most complete, were chosen for in- 
tensive study—Prediction Study Two. These 
cases include 27 individuals who expressed 
teaching as their first choice of occupation on 
the admission blank. 

A great deal of information about these 
persons was collected, in part by various uni- 
versity officials in admitting and recording 
progress of each student in the University, 
and in part by the Teacher Personnel Re- 
search Committee. 


From the University of Wisconsin Applica- 
tion blank, the following data were obtained 
relative to entering freshmen: (1) occupation 
of father; (2) number of siblings older, 
younger, and total siblings; (3) participation 
in community activities; (4) types of maga- 
zines read; (5) recreational activities; (6) 
work experience; (7) secondary school activ- 
ities; (8) scholastic recognition in the sec- 
ondary school; (9) high-school principal’s 
prediction of academic success in college; 
(10) date of high-school graduation; (11) 
hours of home study during senior year of 
high school; (12) interest in teaching; and 
(13) five personality ratings in response to 
the following questions: a. How does his 
appearance and manner affect others? b. Does 
he need constant prodding or does he go 
ahead with his work without being told? 
c. Does he get others to do what he wishes? 
d. How does he control his emotions? and 
e. Has he a program with definite purposes 
in terms of which he distributes his time and 
energy? 

Certain other data were available in the 
records of the registrar of the University in- 
cluding the percentile rank in the respective 
high-school graduation class, a transcript of 
each student’s high-school credits, intelligence 
quotient based on the Henmon—Nelson Test 
of Mental Ability given during the senior year 
of high school, percentile rank on the 
Henmon-Nelson Test of Mental Ability based 
on both high-school and college norms, per- 
centile rank on the American Council on Edu- 
cation Psychological Examination for College 
Freshmen and Cooperative English Test ad- 
ministered to all freshmen at the time of their 
entrance into the University, the predicted 
grade point average of each student using a 
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multiple regression of high-school rank and 
the percentile rank on the American Council 

logical Examination For College Fresh- 
men, and the actual grade point averages by 
semesters at the University. 

The records also contained each student’s 
course elections, special faculty action with 
respect to grades, the results of speech tests 
for those who chose the test in lieu of a course 
in speech, and the major department’s recom- 
mendation for the University Teacher’s Certi- 
ficate. 

Certain courses are required as part of the 
professional education of teachers at the Uni- 
versity of Wisconsin. Instructors of these 
courses were instrumental in supplying much 
information. In Education 73, The Child: His 
Nature and His Needs, each student was re- 
quired to prepare an autobiography of his 
educational experience from childhood to 
maturity. The directions for the autobiog- 
raphy are given in Appendix A.3.* In both 
Education 73, The Child: His Nature and 
His Needs, and Education 74, The School and 
Society, students were required to participate 
in a special activity. The former activity was 
concerned with direct experiences with chil- 
dren while the latter involved a community 
project. A sample of the rating sheet used is 
given in Appendix A.4.* 

In Education 75, The Nature and Direc- 
tion of Learning, and in the course in the 
teaching of the major subject, each student 
had directed practice teaching thereby coming 
in contact with the classroom responsibilities 
of a teacher. The rating and grades assigned 
by the supervisor of practice teaching were 
recorded on a rating blank (Appendix A.5)* 
and made available to the Teacher Personnel 
Research Committee. Near the conclusion of 
the pre-service education period, each student 
was interviewed twice by members of the staff 
of the School of Education. Each interview 
was 40 minutes in length and was con- 
ducted from a set of previously agreed upon 
questions (Appendix A.6).* By means of a 
recording instrument of which the student was 
aware, stenographic reports were made of the 
interviews. 

Each student was also asked to fill out two 
data booklets relative to his background, in- 
terests and activities. The Student Data 
Booklet (Appendix A.7)* was completed dur- 
ing the junior year of University study and 

* See original thesis on file, Library, University of Wisconsin. 
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the Supplementary Student Data Booklet 
(Appendix A.8)* during the senior year. 
During the 1942-43 school year, which was 
the senior year of the persons with whom this 
study is concerned, methods and techniques 
were developed by the Teacher Personnel 
Committee for summarizing the data which 
had been collected on each student in the 
study. The following areas and questions were 
thought pertinent and indicative of future 
teaching success: 
I. General Endowment, 
Experience 
A. Aptitudes 
1. Is the teacher intelligent and men- 
tally alert? 
2. Does the teacher show any special 
aptitude(s) for teaching? 
B. Interests, attitudes, and ideals (moti- 
vation) 
1. Is the teacher interested in teach- 
ing? 
2. Does the teacher like children? 
3. Does the teacher like the subject 
that she is to teach? 

. Is the teacher anxious to succeed? 

. Has the teacher an adequate and 
acceptable list of extra-curricular 
and recreational interests and 
hobbies? 

. Has the teacher concern over the 
general welfare (social sensitivity) 
of others? 

7. Has the teacher a good sense of 
values? 
8. Is the teacher’s code of ethics ade- 
quate? 
C. Cultural background 
t. Is the teacher’s general cultural 
background adequate for effective 
leadership? 
D. Social adequacy 
1. Is the teacher’s relations with oth- 
ers, in general, pleasant and effec- 
tive? 

. Is the teacher socially sensitive to 
the needs of others? 

- Does the teacher meet the require- 
ments of human relations situations 
according to known standards, cus- 
toms, and mores? 

E. Emotional maturity 
1. Is the teacher emotionally mature 
in her reactions to annoying situa- 
tions? 


Education, and 
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. Is the teacher reasonably free from 


neurotic tendencies? 


. Is the teacher well-poised and emo- 


tionally stable? (Does the teacher 
give the appearance of being calm, 
confident, and collected in difficult 
situations? ) 


F. Health 


I. 


2. 


Has the teacher physical defects 
that may limit her effectiveness as 
a teacher? 

Has the teacher the physical stam- 
ina and health to meet the energy 
requirement of teaching? 


. Personal qualities 


I. 
2. 


3- 


9. 


Is the teacher adaptable? 

Is the teacher resourceful (initia- 
tive, originality, creativeness) ? 

Is the teacher sensitive to the feel- 
ings of others (considerate) ? 


. Is the teacher dependable (respon- 


sible)? 


. Is the teacher cooperative? 
. Is the teacher open-minded, objec- 


tive, and reasonably free from per- 
sonal bias? 


7. Is the teacher interested and alert? 
8. 


Is the teacher an interesting and 
attractive person? 

Is the teacher refined (practice of 
common courtesies) ? 


. General skills 


I. 


2. 


s 
4. 


Is the teacher skilled in oral and 
written expression (power to com- 
municate ideas) ? 

Is the teacher skilled in recognizing 
and solving problems? 

Is the teacher skilled in work and 
study techniques? 

Is the teacher skilled in personal 
relations? 


II. Special Skills and Abilities 
A. The student as a prospective director 
of learning 


I. 


Is the student’s knowledge of con- 
tent (subject matter to be taught) 
adequate for effective teaching? 


. Does the student see and appre- 


ciate the opportunities for meeting 
pupil-community needs through in- 
structional leadership in his subject 
matter area? 


. Is the student’s knowledge of 


pupils and how they learn adequate 
for effective teaching? 


4. 
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Is the student’s knowledge of 
methods and materials adequate for 
effective instructional leadership? 


. Is the student interested in teach- 


ing and in the subjects she is 
trained to teach? 


. Has the student had experience in 


guiding the learning experiences of 
children and young people? 


B. The student as a prospective teacher 
counsellor and friend of adolescents 


I. 


4. 
5. 


Has the student an adequate 
understanding of the psychological 
background, facts, and principles of 
human behavior and development? 


. Has the student an adequate 


understanding of the sociological 
background of the prob!ems and 
conditions affecting behavior and 
what services are available to help 
young people with their problems? 


. Is the student acquainted with 


basic guidance techniques? (Be- 
havior records, testing, case studies, 
etc.)? 

Do children seek her help and 
advice? 

Has the student had experience as 
a teacher counsellor? 


C. The student as a prospective member 
of a school staff 


I. 


2. 


Is the student’s understanding of 
the place of the school in the social 
order adequate for effective educa- 
tional leadership? 

Has the student had successful ex- 

perience in group work with his 

contemporaries? If so, have such 
relationships shown: 

a. That the student is assuming 
responsibility? 

b. That the student is generous in 
giving credit for the contribution 
of others? 

. That the student is willing to 
compromise and accept differ- 
ences? 

. That the student is free from 
petty personal differences, gossip, 
et cetera? 

. That the student has the ability 
to think and work creatively for 
the improvement of the organ- 
ization? 


. Has the teacher had experience as 


a member of a school staff? 
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D. The student as a prospective teacher 
in a community 
1. Does the student understand the 
broader social background of effec- 
tive community activity? 

. Does the student understand the 
role of the teacher in the commu- 
nity as teacher and citizen? 

. Has the student had successful ex- 
perience in community leadership? 
If so, has such responsibility shown: 
a. That the student assumes re- 

sponsibility ? 

b. That the student is generous in 
giving credit for the contribution 
of others? 

. That the student is willing to 
compromise and accept differ- 
ences? 

. That the student is free from 
petty personal differences? 

. That the student has the ability 
to think and work creatively for 
the improvement of the organ- 
ization? 

E. The student as a person 
1. Does the student possess the health 


to meet the energy requirement of 
teaching? 

. Does the student in her relation- 
ship with others practice the demo- 
cratic way of life? (Does she re- 


spect personality, have concern 
over the general welfare of others, 
et cetera? 

. Has the student a well-thought-out 
philosophy of life, a good sense of 
values, and an acceptable code of 
ethics? 

4. Is the student anxious to succeed? 


As a result of the above analysis, two sum- 
mary sheets were developed (Appendix A.9o 
and Appendix A.to).* The second of these 
two sheets was used to predict probable suc- 
cess in teaching with evaluations being made 
by several members of the staff of the School 
of Education. 

Predictions of teaching success were made 
by a member of the student’s major depart- 
ment. The evaluations were made on a five 
point scale of outstanding, above average, 
average, below average, and poor. These were 
later quantified by assigning values of 5, 4, 3, 
2, and 1 respectively. 

* See original thesis on file, Library, University of Wisconsin. 
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A special study was made of the accuracy 
of the predictions of educational specialists 
made from both subjective and objective 
data. In one instance, two members of the 
staff of the School of Education were supplied 
with three kinds of objective data: (1). aca- 
demic grades, (2) test scores, and (3) the 
data booklet filled in by each student as a 
junior and again as a senior. Each was asked 
individually to make predictions on a five 
point scale (poor, below average, average, 
above average, and superior) of each stu- 
dent’s probable success as a teacher. The sub- 
jective data available was then given to one 
member and he was asked to make evalua- 
tions, using the same scale, of probable suc- 
cess of each student in teaching. Both mem- 
bers of the staff of the School of Education 
then made a prediction, again individually, on 
the basis of a combination of objective and 
subjective measures and attributes. 

The data gathered prior to graduation with 
the source or sources of the information, may 
be summarized as follows: 


1. Home background. 
Application for Admission Blank, Uni- 
versity of Wisconsin. 
Data booklet. 
University records. 

. Secondary school background. 
Application for Admission Blank, Uni- 
versity of Wisconsin. 

Data booklet. 
University records. 

. Financial support. 
Data booklet. 
University records. 

. Academic achievement. 
University records. 

. Measures of intelligence. 
Henmon-Nelson Test of Mental Abil- 
ity in terms of both high school and 
college norms—University records. 
American Council on Education Psy- 
chological Examination for College 
Freshmen—University records. 

. Cultural background. 

American Council on Education Coop- 
erative General Culture Test—admin- 
istered by Teacher Personnel Commit- 
tee. 
7. Skills in language. 

American Council on Education Coop- 
erative Reading Test C2—administered 
by Teacher Personnel Committee. 





September, 1946] 


American Council on Education Coop- 
erative English Test—University rec- 
ords. Speech examination—University 
records. 
. Majors and minors pursued. 
University records. 

. Evaluation of practice teaching. 
University tecords. 
Rating sheets of Education 75 and 
major. 

. Professional suitability. 

National Teachers Examination—ad- 
ministered by Teacher Personnel Re- 
search Committee. 

. Attitudes toward and abilities in activ- 
ities. 

Rating sheets of Education 73 and 74. 

. Ratings as a student, as a leader, as an 
advisor, and as a person. 

Rating sheets of Education 75 and 
major. 

. Recreational interests and activities. 

Interviews. 
Data booklets. 
University records. 

. Motivation. 

Application for Admission Blank, Uni- 
versity of Wisconsin. 

Interviews. 

Data booklets. 

. Work experience. 

Application for Admission Blank, Uni- 
versity of Wisconsin. 

Data booklets. 

University records. 

. Professional judgment; sociability; work 
habits; motivation and values; original- 
ity, creativity, and initiative; and general 
impressions. 

Interviews. 

. Other miscellaneous facts. 
University records. 
Data booklets. 
Letters to high school principals. 
Letters to colleges from which students 
transferred (Appendix A.11).* 


One hundred sixteen of the 223 persons 
who were graduated and received the Univer- 
sity Teacher’s Certificate in 1943 accepted 
teaching positions. Of the 116, 58 women 
were selected for intensive study since the 
records of these individuals were quite com- 
plete and the men, with the exception of a 
very few, had entered the armed services, 

* See original thesis on file, Library, University of Wisconsin. 
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With the purpose of predicting success of 
future graduates of the University of Wiscon- 
sin through study of the above mentioned 58 
individuals, an effort was made to assess care- 
fully their strengths and weaknesses and to 
reach a reliable evaluation of the general effi- 
ciency of each as a first-year teacher. A series 
of meetings was held over a period of several 
months in order to secure agreement upon the 
aspects of teaching to be evaluated. Repre- 
sentatives of the School of Education, Wis- 
consin State Department of Public Instruc- 
tion, Department of Educational Methods of 
the University, and University staff members 
in subject areas most frequently represented 
in the sample studied agreed, as the result of 
the meetings, to use the M-Blank, Data for 
Individual Staff Members, 1940 edition, Co- 
operative Study of Secondary School Stand- 
ards, as a criterion for evaluating the teaching 
efficiency of each teacher. A copy of the orig- 
inal blank is to be found in Appendix A.12.* 
However, in most cases, the Wisconsin Adap- 
tation of the M-Blank was used (Appendix 
A.13).* 


Prior to visiting the teacher, a letter of in- 
quiry was sent to her asking for her teaching 
schedule (Appendix A.14).* Two members of 
the staff of the School of Education, and a 
representative of each of the State Depart- 
ment of Public Instruction, the Department 
of Educational Methods, and the principal or 
superintendent of the school in which the 
teacher was located made separate and inde- 
pendent evaluations of the teaching efficiency 
of each teacher. Time was spent at the 
school in which each teacher was located talk- 
ing with her, studying the setting in which 
she worked, observing her teach, viewing 
samples of lesson plans and exhibits of learn- 
ing aids, and examining some of the more 
tangible products of pupil effort. 

The plan was for each rater to visit and 
spend at least one-half of a school day with 
each teacher. However, nine teachers were 
visited by only three evaluators and 27 by 
only four. All others were evaluated by the 
five persons. In all cases, a visit of half a day 
did not prove feasible; but each rater 
attempted to obtain as complete a picture as 
possible of both the teacher’s efficiency and 
the setting in which she was working. 

In addition, the principal or superintendent 
was asked to complete Guide Sheet C ( Appen- 


* See original thesis on file, University of Wisconsin. 
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dix A.15).* This was a special evaluation of 
the teacher (1) as a director of learning, 
(2) as a friend and counselor of students, 
(3) as a member of the school staff, (4) as 
a member of the community, and (5) as a 
person. One member of the staff of the School 
of Education also made an evaluation on the 
Barr—Harris Teacher’s Performance Record 
(Appendix A.16).* 

To these evaluations were added others ob- 
tained from a sampling of students taught by 
each teacher. The evaluations were secured by 
a representative of the School of Education 
through small informal group conferences. 
After proper rapport was established, the fol- 
lowing three questions were asked: (1) What 
do you like best about this teacher? (2) What 
do you like least about this teacher? (3) How 
would you rank this teacher relative to other 
teachers with whom you have classes (first, 
second, third, et cetera)? The answers were 
given in private on a plain sheet of paper 
without signature. In order to reduce the re- 
sponses to the last question to a comparable 
basis each student was asked to indicate the 
number of teachers from whom he was receiv- 
ing instruction. 

A composite of the supervisory ratings on 
the M-Blank is the major criterion of teach- 
ing efficiency in this study. The pupil evalua- 
tions were treated as a second and separate 
criterion. A third criterion, separate from the 
other two, is the residual gain made by stu- 
dents in twenty-eight different classes, in the 
subject areas of English, biology, civics, social 
science, and general science. The efficiency of 
only 17 teachers is measured in this way since 
some of the teachers had two classes which 
were given standardized achievement tests. 


Statistical methods are employed for the 
most part in the treatment of the data. 
Though a variety of objective facts were 
collected relative to each of the 58 persons 
involved in the study, an attempt was made 
to supplement these through the use of a 
variety of subjective techniques. These pro- 
cedures will be discussed in Section IV. 

The chief purpose of this study is to deter- 
mine the predictive value of both objective 
and subjective data, that might be collected 
relative to a student prior to and during Uni- 
versity work, for measuring future success in 
teaching. The objective data consisted of a 
great number of factors such as grades, test 

* See original thesis on file, Library, University of Wisconsin. 
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scores, and items from the data booklets. The 
subjective facts were those collected from in- 
terviews, autobiographies, and the personal 
reactions of various persons to each student. 
These data were brought together by two per- 
sons working independently of each other. 
The predictive value of the measures is 
studied through the use of correlation tech- 
niques. 


II.2. DEscrrPTION OF MEASURES APPLIED 
TO TEACHERS 


The measures first discussed are those 
which were applied to the teacher prior to 
commencement of her teaching responsibil- 
ities. They include evaluations made during 
the period of institutional education as well 
as certain measures obtainable about the indi- 
vidval prior to the beginning of university 
work. Certain measures, then, are estimates 
of secondary school attainment while others 
apply only to university preparation. Meas- 
ures applied to the teacher during her first 
year of teaching are described in Section I1.4 
and Section IV. 

As was pointed out in Section II.1, a large 
amount of data was collected with reference 
to each person as an entering or prospective 
freshman and later as a student in the uni- 
versity. These data were brought together 
into a number of measures, as follows: 

1. Rank in High-School Class. The per- 
centile rank was determined by dividing the 
numerical rank of the student in his respec- 
tive high-school graduation class by the num- 
ber of students in the class. For Prediction 
Study Two, T-scores were used (Appendix 
B.1).* 

2. The Henmon—Nelson Test of Mental 
Ability, Form C, High School Intelligence 
Tests, Grades 7—12, 1935, New York: Hough- 
ton Mifflin Company (Appendix C.1). In Pre- 
diction Study One, percentile rank based on 
the high-school norms for seniors was used. 
In Prediction Study Two, the percentile rank 
based on both high-school and college norms 
separately and as a composite was employed. 
These were transferred to standard T-scores 
in order to approximate a normal probability 
distribution (Appendix B.1).* 

3. Hours of Home Study During Senior 
Year of High School. 

4. Siblings in Family. Three measures were 
obtained, number of siblings younger than the 

* See original thesis on file, Library. University of Wisconsin. 
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individual in question, number of siblings 
older, and total siblings. 

5. High-School Principal’s Prediction. This 
is a general estimate of probable scholastic 
success in college made on a five point scale: 
will probably fail, probably barely satisfac- 
tory, will probably be an average student, 
should earn superior grades, and can be an 
honor student. The rating was quantified by 
assigning values of 1, 2, 3, 4, and 5 respec- 
tively to the above mentioned estimates. 

6. High-School Personality Ratings. These 
ratings were quantified in the same manner 
as were those made by the principal. 


a. How Does His Appearance and Manner 
Affect Others? The five point scale 
ranges from “avoided by others” to 
“sought by others.” 

. Does He Need Constant Prodding or 
Does He Go Ahead With His Work 
Without Being Told? The scale has five 
divisions from “needs much prodding to 
do ordinary assignments” to “seeks and 
sets for himself additional tasks.” 

. Does He Get Others to Do What He 
Wishes? The five point scale ranges 
from “probably unable to lead his fel- 
lows” to “displays marked ability to lead 
his fellows; makes things go.” 

. How Does He Control His Emotions? 
There are seven divisions from “too 
easily moved to anger or fits of depres- 
sion” to “unusual balance of responsive- 
ness and control.” 

». Has He a Program With Definite Pur- 
poses in Terms of Which He Distributes 
His Time and Energy? A five point 
scale is used from “aimless trifler” to 
“engrossed in realizing well-formulated 
objectives.” 


7. Interest in Teaching. Students entering 
the University of Wisconsin indicated their 
first, second, and third choices of occupation 
on the Application for Admission blank. 
Those indicating teaching as their first, sec- 
ond, or third choice were treated in two ways: 
(1) through a dichotomous grouping of inter- 
ested and not-interested, the first group being 
composed of those indicating teaching as their 
first choice and the second those indicating 
teaching as their second or third choice, and 
(2) by assigning values of 3, 2, and 1 respec- 
tively to first, second, and third choice of 
teaching as an occupation. 
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8. American Council on Education Cooper- 
ative English Test (Usage, Spelling, and 
Vocabulary), Form 1937, New York: Cooper- 
ative Test Service (Appendix C.21).* This 
test was administered to entering freshmen. 
The percentile rank was used in Prediction 
Study One and the T-score in Prediction 
Study Two (Appendix B.1).* 

9. American Council on Education Psycho- 
logical Examination for College Freshmen, 
1938 edition, Washington, D. C.: The Amer- 
ican Council on Education (Appendix C.22).* 
This examination, administered to entering 
freshmen during Orientation Week, 1939, is 
composed of six divisions: arithmetic, analo- 
gies, number series, completion, artificial lan- 
guage, and same-opposite. The percentile rank 
was used in Prediction Study One and the 
T-score in Prediction Study Two (Appendix 
B.1).* 

1o. American Council on Education Psycho- 
logical Examination for College Freshmen, 
1939 edition, Washington, D. C.: The Amer- 
ican Council on Education (Appendix C.23).* 
Students enrolled in the School of Education 
took this test. T-scores were used in the 
analysis. 

11. American Council on Education Coop- 
erative General Culture Test, Revised Series 
Form Q, New York: Cooperative Test Serv- 
ice, c. 1940 (Appendix C.24).* The test con- 
sists of sub-tests of current social problems, 
history and social problems, literature, fine 
arts, science, and mathematics. It was given 
to students enrolled in the School of Educa- 
tion. T-scores were used (Appendix B.1).* 

12. American Council on Education Coop- 
erative English Test, Test C2: Reading Com- 
prehension (Higher Level), Form Q, New 
York: Cooperative Test Service, 1940 (Ap- 
pendix C.25).* This test administered to stu- 
dents in the School of Education consists of 
vocabulary, speed of comprehension, and level 
of comprehension. The raw scores were 
changed to T-scores (Appendix B.1).* 

13. National Teachers Examination. Raw 
scores were transformed to T-scores for this 
test given to students in the School of Edu- 
cation. 

14. Predicted Grade Point Average. The 
registrar’s staff of the University of Wiscon- 
sin, using high-school rank and the percentile 
rank on the American Council on Education 
Psychological Examination, 1938 edition, pre- 

* See original thesis on file, Library, University of Wisconsin. 
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dicted the probable grade point averages of 
each entering freshman using the regression 
equation: X, = .o128 X, + .o140 X, — 
.4335, in which X, = predicted grade point 
average, X, == percentile rank on the Ameri- 
can Council on Education Psychological Ex- 
amination, and X, = percentile rank in 
high-school class. 

15. Actual University Grade Point Aver- 
age. In computing the actual grade point 
averages, the following relationship exists 
between letter grades and grade points: A = 
3 grade points, B = 2 grade points, C = 1 
grade point, D — o grade points, and F = 
—', grade point. 

Grades were considered individually for 
some courses and in combination in other in- 
stances as of the succeeding: 


a. Freshman and sophomore grade point 
average; taken individually and as a 
composite. 

. Combined junior and senior grade point 
average. 

. Combined grade point average for four 
years in college. 

. Grade point average in the major sub- 
ject. 

. Grade point average in the first minor. 

. Grade point average in the second minor. 

. Grade point average in all professional 
education courses. 

. Grade point averages for Education 73, 
The Child: His Nature and His Needs; 
Education 74, The School and Society; 
and Education 75, The Nature and 
Direction of Learning; taken separately 
and combined. 

i. Composite of major and Education 73, 
74, and 75 grade point averages. 

. Practice teaching in the major and in 
Education 75; taken separately and 
combined. Practice teaching grades were 
assigned by the critic teachers under 
whom each student did her practice 
teaching. Two separate grades were 
assigned in two different semesters usu- 
ally in different subjects and by different 
critics. (Appendix A.5).* 

k. Speech course grade point average. 


16. Ratings made in Education 73 and 74. 
These ratings on (1) ability in the assigned 
activity and (2) attitude to the assigned 
activity were taken separately and com- 

* See original thesis on file, Library, University of Wisconsin. 
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bined for each course and then a composite 
was made for both courses. For the rating 
sheets used, reference is made to Appendix 
A.4.* Quantification was done by assigning 
the following numerical values to the letters. 
A= 5, B= 4,C =3, D=2,andN = 1. 

17. Rating of each student as a person, as 
a student, as a group leader, and as an 
advisor to individuals. These ratings were 
made in each of the two practice teaching 
courses, the major and Education 75. Numer- 
ical values of 4, 3, 2, 1, and o were assigned 
respectively to the divisions of I, II, III, IV, 
and V on the rating sheet shown in Appendix 
A.5.* The ratings were employed separately 
and in combined form. 

18. The combined impression of two inter- 
viewers relative to professional judgment: 
social competency; work habits; motivation 
and values; originality, creativity, and initia- 
tive; with an overall general impression. Each 
rating was taken singly and then as a part 
of a composite. For the interview data, each 
student in the School of Education was given 
two 40 minute standardized interviews (Ap- 
pendix A.6)* with two different members of 
the staff of the Department of Education. 
Following the interview, each interviewer re- 
corded his general impressions as to each per- 
son’s probable success as a teacher; profes- 
sional judgment; social competency; work 
habits; motivation and values; originality, cre- 
ativeness, and initiative; and general impres- 
sions. The above impressions were recorded as 
verbal statements. To translate the descriptive 
terms into quantitative values, the language 
habits of each interviewer were studied. The 
translation according to “Scale Word and 
Point Rating,” and “Vocabulary Inventory 
and Frequency of Evaluating Terms Used in 
Predicting Success of Beginning Teachers,” 
are presented in Tables B.t and B.2, Appen- 
dix B.2.*Seven categories of competency were 
set up for each: very superior, superior, above 
average, average, below average, poor, and in- 
ferior with values of 5, 4, 3.5, 3, 2.5, 2, and 1 
respectively. A composite of the ratings of 
two interviewers was used as a single score in 
predicting teaching efficiency. 

19. The major department’s prediction as 
to probable success of each person as a 
teacher. The ratings with their respective 
numerical values were superior, 5; above 
average, 4; average, 3; below average, 2; and 
poor, TI. 


* See original thesis on file, Library. University of Wisconsin. 
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20. A prediction of teaching efficiency 
made by an educational staff member from 
an accumulation of objective data and an 
accumulation of subjective data taken sepa- 
rately and combined. He was asked to make 
predictions on a five point scale of superior, 
above average, average, below average, and 
poor. These were later transferred to a scale 
of 5, 4, 3, 2, and 1 respectively. The objective 
data supplied were academic grades, test 
scores, and the two data booklets completed 
by the student during the junior and senior 
year. The subjective data consisted of the 
interviews, autobiographies, and data book- 
lets. The student’s name was deleted from all 
materials. 

Individuals making these predictions came 
to a final estimate through a series of steps: 
(1) the facts were first recorded for each stu- 
dent for each of a number of categories (Ap- 
pendix A.ro);* from these data certain infer- 
ences were then drawn; and finally a general 
estimate of each person’s probable success in 
teaching was reached. 

The procedure was applied by two mem- 
bers of the educational staff (B and L) to get 
some estimate of the worth of these 
approaches to prediction. 


IT.3. DESCRIPTION OF THE SAMPLES 


As has been explained previously, this in- 
vestigation consists of two separate prediction 
studies: (1) a prediction of what persons 
seeking admission to the School of Education 
will be admitted at the beginning of the 
junior year, and (2) a prediction of the type 
of person who will be successful in teaching. 

For convenience, the investigations are 
called Prediction Study One and Prediction 
Study Two, respectively. Each study, for all 
practical purposes, is composed of a different 
and distinct sample although 22 of the per- 
sons considered in Study One are also a part 
of Study Two. 


II.31. THe SAMPLES OF PREDICTION 
Stupy ONE 


The criteria for this study, as will be out- 
lined in detail in Section II.4, are of two 
types: (1) a composite of university freshman 
and sophomore grade point averages and (2) 
the dichotomy of being admitted or not being 
admitted to the School of Education at the 
beginning of the junior year. 

* See original thesis on file, Library. University of Wisconsin. 
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The samples considered in this section are 
divided according to three general definitions 
of purpose. The first group (II.311) consists 
of all but four of the 204 persons signifying 
teaching as their first choice of occupation on 
the Application for Admission blank, 1939, 
and will be described as a group, that is, with- 
out division as to sex. The four persons elim- 
inated were dropped from the study because 
of withdrawing from the University prior to 
completion of one semester of work. 

The second group (II.312) is composed of 
the same individuals as the first but is divided 
according to sex. These persons were treated 
according to men and women candidates in 
using the criterion of combined freshman and 
sophomore grade point averages. The third 
group (II.313) differs from the second only 
in being further classified according to 
whether the individuals were or were not ad- 
mitted to the School of Education and is the 
group under consideration in employing the 
criterion of being admitted or not being ad- 
mitted. With this restriction, 41 persons were 
eliminated from the first group. These indi- 
viduals were those who were graduated in 
other fields than teaching and did not enter 
the School of Education and those who trans- 
ferred to other colleges or universities prior 
to the junior year. 

By definition of the purpose of the study, 
it was necessary to cease consideration of the 
graduates in other fields than education for 
they may have been admitted to the School 
of Education had they sought admission. 


II.311. A DEscR!PTION OF THE PRE-UNIVER- 
SITY BACKGROUND OF PERSONS EXPRESSING 
TEACHING AS THEIR Frrst CHOICE OF 
OccuPATION AND ENROLLING AT THE 
UNIVERSITY OF WISCONSIN IN 
SEPTEMBER 1939 


In the discussion to follow, descriptions 
will be made according to the classifications 
graduated with the University Teacher’s 
Certificate; graduated from other fields than 
teaching; withdrew from the University be- 
cause of being dropped or being placed on 
probation or advised to withdraw; discontin- 
ued university work because of illness, lack of 
finances, marriage, or dissatisfaction; trans- 
ferred to other schools; and entered the 
armed services. All tables relative to the items 
of background discussed are located in Ap- 
pendix B.2.* 


* See original thesis on file, Library, University of Wisconsin 
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An analysis of the occupational status of 
the fathers of prospective teachers indicates 
that agricultural pursuits predominate, with 
farming, merchandising, and management 
ranking highest. Since all students under con- 
sideration are Wisconsin residents, this might 
well be expected. Merchandising shows a close 
farm connection inasmuch as most of the per- 
sons considered were engaged in this occupa- 
tion as cattle buyers and sellers, grain dealers, 
and potato and tobacco merchants. The man- 
agerial group includes a large number of small 
business men operating stores. It might then 
be concluded that prospective teachers come 
from homes with average income or below. 

In families with more than one child, prac- 
tical experience in human associations, self- 
control, and cooperative attitudes can well be 
developed. Since nearly half of the persons 
interested in teaching have no younger broth- 
ers or sisters, interest was developed through 
some other source than contact and working 
with younger siblings. The group dropped 
from the University have a larger range and 
mean number of brothers and sisters younger 
than is true of any other group. Those who 
were graduated came from smaller families 
than students in the other groupings and par- 
ticipated in more community activities, 
emphasis being placed on boy and girl scouts, 
church organizations, Y. W. and Y. M. C. A., 
and 4H and F. F. A. 

No real difference is apparent in the num- 
ber or types of magazines read by the various 
groups. The magazines read most frequently 
are Reader’s Digest, Life, American, McCall’s, 
Ladies Home Journal, Saturday Evening Post, 
Colliers, Good Housekeeping, Time, News- 
week, and Woman’s Home Companion. The 
average person reads three different maga- 
zines. 

Preferences in recreational activities are 
for reading, music, swimming, dancing, the 
theatre, hiking, camping, skating, and tennis. 
About five activities are participated in by 
the average candidate. 

Fewer persons who are graduated from the 
University have work experience than those 
who are not. However, those of the graduat- 
ing group who did work prior to matriculation 
were for the most part in semi iali 
positions such as child care, clerking, teach- 
ing, bookkeeping, and bank and library posi- 
tions whereas the other groups were located 
to greater degree in odd jobs such as care of 
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lawn, newsboy, and the like. The fact that 
85.7 per cent of the persons who withdrew 
from the University had previous work ex- 
perience may give reason for their later with- 
drawal, for some, undoubtedly, were receiving 
substantial incomes and decided to return to 
the position. Others may have withdrawn due 
to lack of finances and inability to secure 
part-time jobs while at the University. 

In the secondary school, music was the 
activity in which the greatest number of per- 
sons participated. Other popular activities 
were those in the fields of dramatics, litera- 
ture, athletics, and forensics with the persons 
who were dropped participating to greatest 
degree in dramatics and athletics. 

In analyzing the table of scholastic recogni- 
tion in the secondary school, there appears a 
close relationship between high scholastic 
ability prior to University entrance and being 
graduated from the University. Twenty-five 
per cent of the School of Education graduates 
and 34.8 per cent of the other graduates were 
not recognized scholastically. However, the 
other groups do not compare in this respect 
for 79.1 per cent of those who were dropped, 
51.5 per cent of those who withdrew, 59.0 per 
cent of those who transferred, and 60.0 per 
cent of those who entered the armed services 
did not receive scholastic recognition. 

Closely related to scholarship is the high- 
school principal’s rating or prediction of prob- 
able success in college. The dropped division 
received the lowest ratings. University grad- 
uates were most frequently rated as superior 
students. Of these, the persons who were grad- 
uated with the University Teacher’s Certifi- 
cate received the highest percentage of “can 
be an honor student” rating. 

Since most of the transfer group was elim- 
inated from the prediction study using the 
dichotomous criterion reported in Section III, 
it would seem desirable to present briefly a 
follow-up of the immediate activities of these 
persons after withdrawing. The positions 
accepted by the graduates are also reported. 

Of the 17 students who left the University 
with the view of transferring to other schools, 
15 were traced by means of a letter of inquiry 
sent to the school to which the student had 
indicated he would transfer. Four of these 
corresponded with a particular school and 
then did not enter, nine enrolled but were not 


graduated, and two were graduated with a 
high C average. The two persons last consid- 
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ered accepted teaching positions. Of those 
who entered another college and were not 
graduated, one entered the armed services, 
one of the women was married, and one 
accepted a rural school assignment. The aver- 
age length of time spent in school after trans- 
ferring was two semesters. 

Fifty replies were received as the result of 
inquiries addressed to the 52 individuals who 
were graduated with the University Teacher’s 
Certificate. Thirty entered upon teaching 
assignments. Prior to the end of the first year 
of teaching, five of these resigned, two women 
being married, one person entering the armed 
services, one becoming a laboratory techni- 
cian, and the other a book illustrator. Seven 
of the remaining 20 who did not accept teach- 
ing positions entered the armed services after 
graduation, six of the women were married 
but used their university education in teach- 
ing night classes and doing substitute teach- 
ing, and seven were employed in the business 
field in secretarial, sales, engineering, or tech- 
nical writing work. 

Nineteen of the 23 persons graduated in 
other fields than teaching answered the ques- 
tionnaire. Two took teaching positions, one 
as a physical education teacher in a college 
and the other as a music supervisor in a com- 
paratively large school system; one completed 
the education requirements in another college 
after being graduated from Wisconsin and 
accepted a position in teaching; three of the 
women were married, one worked as a drug 
store clerk, two became nurses, and the re- 
maining ten individuals accepted offerings in 
business, primarily in accounting as pay-roll 
clerks and statisticians. 


II.312. Drvtston AccorDING TO SEX OF 
PERSONS INTERESTED IN TEACHING 


Using the criterion of a composite of uni- 
versity freshman and sophomore grade point 
averages for purposes of prediction of being 
admitted or not being admitted to the School 
of Education at the beginning of the junior 
year of institutional course work, the group of 
persons indicating teaching as first choice of 
occupation on the Application for Admission, 
University of Wisconsin, was divided into 
sections of men and women respectively. 

This was desirable for two reasons. First, 
Prediction Study Two deals only with women 
graduates, and, second, which is a more basic 
reason for division, all mean differences be- 
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tween the men and women are statistically 
significant for the measures of combined uni- 
versity freshman and sophomore grade point 
average, percentile rank in high-school class, 
percentile rank on the Henmon-Nelson Test 
of Mental Ability (high-school and college 
norms), percentile rank on the American 
Council on Education Cooperative English 
Test (Usage, Spelling, and Vocabulary), 
American Council on Education Psychological 
Examination for College Freshmen, high- 
school principal’s prediction of academic suc- 
cess, hours of home study during senior year 
of high school, and predicted university grade 
point average. The least significant difference 
is found in the principal’s prediction where 
the significance level is four-hundredths of 
one per cent. The critical ratios between the 
difference of the means and the per cent sig- 
nificance level are presented in Table I. 


TABLE I 


CRITICAL RATIO OF THE DIFFERENCES BETWEEN 
MEANS AND SIGNIFICANCE LEVEL OF THE 
MEAN DIFFERENCES BETWEEN MEN 
AND WoMEN* 


Critical Sienificance 

Ratio of Difference 
Between of Meansin 
Per Cent** 


Measures Means 


Freshman and Sopho- 
more GPA 
- we Rank H. S. 


00. 02 
00. 00 
00. 00 
00. 00 
00. 00 


00. 00 
00. 04 


00. 00 
00. 00 


3. 691 
5. 574 
4. 561 
5. 233 
9. 565 


7. 430 
3. 555 


4.417 
7.423 


Percentile Eng. Co- 
operative 
Percentile American 


Prin. Prediction H.S. - 
= _ Study Sr. 


** Per cent significance level — 1 — 2 (area 
under the normal curve at C. R.). 


The means, standard deviations of the dis- 
tributions, and standard errors of the means 
for the above measures of Table I are pre- 
sented in Table II. The men, in this study, 
rank below the average on the American 
Council Psychological, English Cooperative, 
and Henmon-Nelson (college norms); and 
rank only slightly above the average in their 
high-school class and on the Henmon—Nelson 
(high-school norms). The women, on the 
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TABLE II 


MEANS, STANDARD DEVIATIONS OF THE DISTRIBUTIONS, AND STANDARD ERRORS OF THE MEANS OF 
MEN AND WOMEN INDICATING TEACHING AS THEIR First CHOICE OF OCCUPATION* 


Men 
M Ea 


Freshman and Sophomore 
GPA 


Percentile Rank H. S. —_-- 
— Hen.—Nels. S 


26. 583 


Percentile Hen.— Nels. ee 44.352 24.717 


Percentile Eng. Cooperative __ 25. 836 
Percentile American Council _ 30.340 
Prin. Prediction H.S._ _- .. 3.183 
Hrs. Home Study Sr. H.S. 1. 200 
Predicted GPA_. . 760 
*Based on sample of 200 cases. 


. 846 
. 828 
. 483 


other hand, rank slightly above the average 
on the first two measures and considerably 
above the average on the last three. In fact, 
the women rank higher than the men on all 
measures here considered with the mean dif- 
ferences, as stated previously, being very sig- 
nificant. 


II.313. Drviston ACCORDING TO SEX AND THE 
DicHotomous TRAIT OF ADMITTED AND 
Not-ADMITTED TO THE SCHOOL OF 
EDUCATION OF PERSONS INTER- 

ESTED IN TEACHING 


As indicated previously, when using the 
criterion of being admitted or not being ad- 
mitted to the School of Education, the group 
under consideration was divided not only in 
terms of men and women but also in terms of 
whether or not each individual was allowed to 
continue preparation for teaching after the 
sophomore year in university. 

The measures receiving special considera- 
tion here are intelligence quotient scores re- 
ported by the high schools from which the 
prospective teachers graduated, percentile 
rank on the Henmon—Nelson Test of Mental 
Ability (college and senior high-school 
norms), percentile rank on the American 
Council Psychological, predicted grade point 
average, composite of college freshman and 
sophomore grade point average, high-school 
principal’s prediction of college success, the 
five high-school personality ratings, hours of 
home study per day during the senior year of 
high-school, percentile rank on the American 
Council English Cooperative, and number of 
siblings in each student’s respective family. 
These distributions are presented in Tables 
ITI-XVII. 


Women 
N Ea En 


. 706 . 059 
22.009 1.908 


1. 700 
2. 002 
2.215 
2.176 
071 
. 088 
. 048 


In this group, as was true of the previous 
discussion, the higher means of the women 
over the men are significant. This is true not 
only considering those who were admitted to 
the School of Education but also from the 
standpoint of the total groups of men and 
women. On only one measure do the men 
appear significantly higher and that is the 
number of siblings in the family. In the five 
high school personality ratings, there appears 
no difference highly in favor of either group. 
In some instances, the men were rated slightly 
higher and in others the women were consid- 
ered slightly superior. 

In all measures with the exception of sib- 
lings, high-school personality ratings, and 
hours of home study, the means of both men 
and women who were admitted to the School 
of Education appear significantly higher than 
the means of those who were not admitted. 


II.32. THe SAMPLE OF PREDICTION 
Stupy Two 


Treated in Prediction Study Two are 58 
former students of the University of Wiscon- 
sin who entered the School of Education in 
1941, were graduated with the University 
Teacher’s Certificate in 1943,1 were graduates 
of Wisconsin high schools, entered upon 
teaching assignments in Wisconsin schools at 
the beginning of the 1943-44 school year, and 
for whom the data collected by the Teacher 
Personnel Research Committee of the Univer- 
sity were most complete. All persons consid- 
ered are women. 


1 One did not receive the University Teacher's Cer- 
tificate. However, all are hereafter referred to as 
being recipients of the certificate. 
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TABLE III 


DISTRIBUTION OF INTELLIGENCE QUOTIENT SCORES FoR MEN AND WOMEN EXPRESSING TEACHING 
AS THEIR First CHOICE OF OCCUPATION* 


Frequency 
C 


= 
3 
s 


Intervals Men 
B 


' Nwe: 


133-135 
130-132 
127-129 
124-126---- - 
121-123. .---- 
118-120. - 
115-117 
112-114 
109-111 
106-108 
103-105-- . 
100-102-_-- 
97- 99_--- 
a. —— 
91- 93___-- 


he Amo me 
' ' 


Ne KK Doo mee 
| CmNWAmemrN: | 
ere DOD CIE: cw 





7 21 ~—-28 37 26 
107.93 108.93 108.68 120.23 111.77 11 
7.80 





B Hee DD OOH In GIMME O 


74 
95 


OD 


* A = Admitted to School of Education. 
B =Not-admitted to School of Education. 
C = Total. 


TABLE IV 


DISTRIBUTION OF PERCENTILE RANK ON THE HENMON-—NELSON TEST OF MENTAL ABILITY 
(COLLEGE NorMs) For MEN AND WOMEN EXPRESSING TEACHING AS 
THEIR First CHOICE OF OCCUPATION* 


Frequency 
Intervals Men o Women 


et OI Co Co CO CO om DODD OF 
| ened 


CHNAANHY ENE whe 
—- 
it NMR WAM Oow-1m 
a 
HR NONIIASCAIHNwAIA A O 





58 45 103 


72.17 52. 03 63. 37 
25. 57 


35 
37. 90 


mm B| cocommwoname www: 


noe 





* A =Admitted to School of Education. 
e = — to School of Education. 
= Total. 





JOURNAL OF EXPERIMENTAL EDUCATION [Vol. 25, No.1 


TABLE V 


DISTRIBUTION OF PERCENTILE RANK ON THE HENMON-NELSON TEST OF MENTAL ABILITY 
(Senior High ScHooLt) For MEN AND WOMEN EXPRESSING INTEREST 
IN TEACHING AS First CHOICE OF OCCUPATION* 


Frequency 


Intervals Women 


we 
5 


> 
Q 
> 


| Com mm PODS mem: 
NN 00M -~I10 0 
1 ANanweakmac W 


‘Ff 
' 


ht CO CO CN CODD me Oe 
‘ ‘ ' ae 


' 6 t ts 
rt CODD CO Com CoOmcO CO wo: 
ie ee 





a 
a 


51 


i) 
1) 


19 


72.39 52. 50 59.91 
25. 75 


* A=Admitted to School of Education. 
ee to School of Education. 
= Total. 


TABLE VI 


DISTRIBUTION OF PERCENTILE RANK ON THE AMERICAN COUNCIL ON EDUCATION ENGLISH 
COOPERATIVE TEST FoR MEN AND WOMEN EXPRESSING INTEREST IN 
TEACHING AS First CHOICE OF OCCUPATION* 


Frequency 


Men Women 
Cc 


> 
Qa 


— 
_ 


[Ot BNE ORAMOIWE 
ss 


' other bor 


‘ 
— 
AWWONAAW-hNI- On 


SOMA COC AT ees 


i ional 





3 


on 
J 
& | arranmana 





* A= Admitted to School of Education. 
——— to School of Education. 
= Total. 
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TABLE VII 


DISTRIBUTION OF PERCENTILE RANK ON THE AMERICAN COUNCIL ON EDUCATION PSYCHOLOGICAL 
EXAMINATION For MEN AND WOMEN EXPRESSING TEACHING AS 
First CHOICE OF OCCUPATION* 


Frequency 
Intervals Men Women 


> 
> 
a 


98-104. 


—_— 
_ 


—s 


AAAIGSAGAATD wre 

' DO Om Clr -1 0 Co CO Or 
CWOAINAANNHKH NNN: 
©0 Wm 00 69 00 6 INDO NI 


tt DOOM 
' Ms 4 
POA nwm: er | 





19 34 59 44 103 


39. 97 26.35 


oe & 


66. 62 41.21 55. 76 
27. 32 





* A = Admitted te School of Education. 
B = Not-admitted to School of Education. 
C =Total. 


TABLE VIII 


DISTRIBUTION OF PREDICTED COLLEGE GRADE POINT AVERAGE For MEN AND WOMEN EXPRESSING 
TEACHING AS THEIR First CHOICE OF OCCUPATION* 


Frequency 
Intervals Men Women 
B C 


2. 10-2. 24 : ii a 
. 96-2. 09-_-_- ae “ on dint 
. 80-1. 94. aes . 

. 65-1. 79_- 
. 50-1. 
. 35-1. 
. 20-1. 
. 05-1. 
. 90-1. 


> 
Q 


mr cocen: 
we 


1 ANENAQAMA AISI © orm DD 


NNeK FOIA wQtdy rrp 
' CIN SW Coro: 


CORON ONC, 
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w 
— 
cc 
-) 
aw 
eo) 


91 


* A= Admitted to School of Education. 
——— to School of Education. 
= Total. 
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TABLE IX 


DISTRIBUTION OF COMPOSITE COLLEGE FRESHMAN-SOPHOMORE GRADE PoINT AVERAGE For MEN 
AND WOMEN EXPRESSING TEACHING AS THEIR First CHOICE OF OCCUPATION* 


Frequency 
Men Women 
B Cc B 


Q 


HMAMWIDhmaAcCCOnon: | 
— 


PWARMOAIISIEHNtS 
— ee 
1 § PwC Cm COCO IHW ~IENND 


MARAWA ANH, 
tt Am OMnww-3N co: 


‘ 
_ 
' 

‘er 

‘er 





: 
z| 
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nf 
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* A = Admitted to School of Education. 
B =Not-Admitted to School of Education. 
C =Total. 


TABLE X 


DISTRIBUTION OF HIGH SCHOOL PRINCIPAL’s PREDICTION OF SUCCESS IN COLLEGE For MEN AND 
WoMEN EXPRESSING TEACHING AS THEIR First CHOICE OF OCCUPATION* 


Frequency 
Comparative Estimate = Women 


1 


Rcom > 


BB as ng ee ee OY 


17 


ed nh  | 
' woDN 


tb tt et Qe ee 





_ 

wo 
c= 
~ 


3. 50 2.97 


_@ Sli waeBakaRa 


& SB 





* A=Admitted to School of Education. 
B = Not-Admitted to School of Education. 
C =Total. 
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TABLE XI 
DISTRIBUTION OF HIGH SCHOOL PERSONALITY RATING (How Does His APPEARANCE AND MANNER 


OTHERS?) For MEN AND WOMEN EXPRESSING TEACHING 
AS THEIR First CHOICE oF OCCUPATION* 


Rating Men 
A B 

ON icin inal cei aban, camp ia earasiis 3 3 
SS eee eee ee roe 1 
ee err 12 15 
i cisdthdinhch eilnatiieskib des dokeiewian 1 7 
ESS Ee ee een 3 5 
eee ener és ron 
Dos ic aii ccd tn hs ioral aeahle witliaeiepiseginks das = 1 
Ss cadens ds mek coms tae a aioe vial = 1 






es tw 
o Gomes 6 WONKA EC 
—_— » 2 
~~ — bP 
aano 3 O 


~~ PDQ 


4 
3 
7 
1 
7 
2 
4 
1 

















* A= Admitted to School of Education. 
B =Not-admitted to School of Education. 
C =Total. 






on 
i) 
(J) 
=) 
=) 
«2 








i 
ow 
0 6 







TABLE XII 
DISTRIBUTION OF HIGH SCHOOL PERSONALITY RATING (DoEs HE NEED CONSTANT PRODDING OR 


Does He Go AHEAD WITH His WorkK WITHOUT BEING TOLD?) For MEN AND WOMEN 
EXPRESSING TEACHING AS THEIR First CHOICE OF OCCUPATION* 


wUononmsnoe 





Men 

A B 

3 4 

: bi 1 

il 6 

1 2 

2 11 

3 

i 2 

1 

i 2 

vie 1 

Total... oo. “19 33 
Nee 4.76 4.14 

Co 





* A = Admitted to School of Education. 
B = Not-Admitted to School of Education. 
C =Total. 
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TABLE XIII 


DISTRIBUTION OF HiGH SCHOOL PERSONALITY RATING (Does HE Get OTHERS TO Do WHaT HE 
WIsHES?) For MEN AND WOMEN EXPRESSING TEACHING AS 
THet First CHOICE OF OCCUPATION* 


Frequency 


x 
S 


Women 
B 


w 


Nee: Ae ONS 


' 
— 





33 


4. 50 4.23 4.32 
1.12 


* A = Admitted to School of Education. 
B =Not-Admitted to School of Education. 
C=Total. 


TABLE XIV 


DISTRIBUTION OF H1GH ScHOOL PERSONALITY RATING (How Does HE ConTrRoLt His EMOTIONS?) 
For MEN AND WOMEN EXPRESSING TEACHING AS THEIR First CHOICE OF OCCUPATION* 


Frequency 


Cc 
12 ‘ 4 
4 aa 
16 


6 
11 


2 


M Women 
B 


Pon a 


— 


' = 
te: aAkmoee Ws 
| COmme 949 


0 er 19 51 
er eae eres 5.05 


¢ — 








* A = Admitted to School of Education. 
B =Not-Admitted to School ofJfEducation. 
C =Total. 
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TABLE XV 


DISTRIBUTION OF HIGH SCHOOL PERSONALITY RATING (HAs HE A ProGRAM WITH DEFINITE PuR- 
POSES IN TERMS OF WHICH HE DistTriputes His TIME AND ENERGY?) For MEN AND 
WoMEN EXPRESSING TEACHING AS THEIR First CHOICE OF OCCUPATION* 


Frequency 


<= 
= 


Women 
B 


wo 


6 
9 
4 
15 


4 


| 
on of Orn 








* A =Admitted to School of Education. 
B =Not-admitted to School of Education. 
C =Total. 


TABLE XVI 


DISTRIBUTION OF Hours Home Stupy Per Day DurING SENIOR YEAR OF HicH ScHoot For MEN 
AND WOMEN EXPRESSING TEACHING AS THEIR First CHOICE OF OcCUPATION* 


Frequency 
No. of Hours Men e Women 
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nom — 
QanrosSwrmrern Qa 


ee 
_ 
CICON C3300 —: et 


. Pm Rote socom mh oN 
et RK) aanmwonwr: 





wo 
a 
oa 
~ 
i 
wo 
_ 
s 


oe 
c 
ow 
— 
~ 
wo 
os 
se 
b 44 
4 





* A=Admitted to School of Education. 
B = Not-Admitted to School of Education. 
C =Total. 
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TaBLe XVII 


DISTRIBUTION OF TOTAL SIBLINGS IN FAMILIES oF MEN AND WOMEN EXPRESSING TEACHING AS 
THEIR First CHOICE oF OCCUPATION* 


Men 
B 


‘ 
ors 


Frequency 


Women 
Cc B 


one 
‘ ' 


mee 
Cle COND CONOR: ets 


WAM ICSC 
te 
AoorwqQcwrnrnr: 





2.74 





* A=Admitted to School of Education. 
B =Not-Admitted to School of Education. 
C =Total. 


In describing the above mentioned persons, 
two different approaches are used. In the first, 
university experiences as reported by the re- 
spective students are presented. This presen- 
tation is concerned with such items as work 
experience, social and extra-curricular activ- 
ities, activities most helpful in contributing to 
university success , hobbies, and honors re- 
ceived while attending the University. The 
group is divided according to major field of 
concentration in college. With this differen- 
tiation, the divisions and number of persons 
in each group are: art, 5; English, 16; home 
economics, 24; music, 3; speech, 2; natural 
science, 2; social science, 4; history, 1; and 
physical education, 1. 

The second approach is concerned with the 
measures more thoroughly analyzed in the 
prediction of teaching efficiency. The group of 
students is the same. However, instead of 
divisions being made according to university 
major field, partition in the final study is 
made according to the principal subjects 
taught during the first year after graduation. 
Defined in this manner, there are five in the 
art group, 16 in English and speech, five in 
history and social science, 23 in home eco- 
nomics, four in music, and five in a miscel- 
laneous grouping including natural science 
and physical education. 


w 
n 


55 
3. 51 
2. 85 


II.321. UNtversity EXPERIENCES OF PERSONS 
PARTICIPATING IN THE PREDICTION 
Stupy or TEACHING EFFICIENCY 


Forty-one of the 58 persons considered 
earned 25 per cent or more of their university 
expenses in such positions as housework, 
tutoring, care of children, counsellor at camp, 
playground director, secretarial work, library 
work, clerking, et cetera. Wherever possible, 
students accepted work which would contri- 
bute in experience to plans for employment 
after being graduated. For example, those 
majoring in English selected secretarial work 
most frequently; those in home economics 
gave preference to housework, secretarial 
assignments, and positions as waitresses; and 
persons in art were most frequently Sunday 
School teachers. 


Twenty-eight persons received experience 
in secretarial work while 19 taught Sunday 
School, 17 were camp counsellors, 15 were 
waitresses, 15 did housework, 12 were clerks, 
11 took care of children, nine were factory 
workers, eight worked in a library, and eight 
did tutoring. In Table XVIII, work experi- 
ence is divided according to the eight previ- 
ously mentioned major subject groupings. 

Extra-curricular and social activities, as 
shown in Table XIX, were relatively popular 
with this group. Thirty-seven report partici- 
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pating in church activities during the time of 
university attendance. In order of number of 
participants, the following were next most 
popular: professional clubs, 33; student gov- 
ernment, 29; sorority, 22; music, 18; U.S.O., 
15; and speech, 14. Of all activities in which 
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23 


students participated, they felt that church 
clubs would be most helpful in later life. 
Music and student government ranked second 
followed by sororities and professional clubs. 
A further breakdown may be found in Table 
XX. 


TABLE XVIII 
WorK EXPERIENCE DuRING INSTITUTIONAL PREPARATION For TEACHING OF THE PERSONS 


PARTICIPATING IN THE 
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TABLE XIX 


SOcIAL AND EXTRA-CURRICULAR ACTIVITIES AND TRAVEL DURING INSTITUTIONAL PREPARATION 
For TEACHING OF PERSONS PARTICIPATING IN THE PREDICTIVE 
Stupy oF TEACHING EFFICIENCY 
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Art lish Econ. 
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TABLE XX 


Activities DuRING INSTITUTIONAL PREPARATION For TEACHING FouNpD Most HELPFUL By 
PERSONS PARTICIPATING IN THE PREDICTIVE STUDY OF TEACHING EFFICIENCY 


Home 


Eng- 
Econ. 


lish 
1 


Activity 


| = NRK WON ONO: 


Teach in Summer - - 
oak hn malta? 


Music Speech 


Teaching Field 
Nat. 
Sci. 


His- 
tory 


Soc. 
Sci. 


TABLE XXI 


Hopsies DURING INSTITUTIONAL PREPARATION For TEACHING OF PERSONS PARTICIPATING IN THE 
PREDICTIVE STuDY OF TEACHING EFFICIENCY 


Hobby 


Collecting was the chief hobby with 16 per- 
sons reporting this activity. Music, reading, 
knitting, sports, photography, and sewing, 
with 14, 12, 10, 8, 5, and § persons partici- 
pating in each respectively, followed in order 
of preference. Both the English and home 
economics groups reported music and collect- 
ing most frequently. Because of the few per- 
sons in the other groups, it is difficult to dis- 


Music 


Teaching Field 

Nat. Soc. 

Sci. Sci. 
1 


Speech 
x ae 
1 1 

1 ‘ 


1 
1 


tinguish popularity of hobbies in each. All 
groups, however, are presented in Table XXI. 

Few persons received the same type of 
honor while at the university. Seven reported 
sophomore honors, and an equal number were 
received into Pi Lambda Theta. There are 20 
examples of recognition among the 24 majors 
in home economics, 15 among the 16 English 
majors, and six in the case of the four social 
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science majors. No honors were reported by 
the art, music, speech, natural science, and 
history groups. Though the types of honors 
are listed in Table XXII, no division is made 
as to the number received by any one indi- 


vidual. 


11.322. DESCRIPTION OF PERSONS PARTICI- 
PATING IN THE PREDICTIVE STUDY OF 
TEACHING ErFFicrency USING 
MEANS AND DEVIATIONS OF 
THE MEAsuRES USED 


In this discussion, 78 measures or combina- 
tions of measures as collected concerning the 
persons participating in the predictive study 
of teaching efficiency are listed. These 
measures, presented in Table XXIII, are 
those attainable prior to the prospective 
teacher’s entrance upon a regular teaching 
assignment after being graduated and involve 
data from both high school and university. 

As previously explained, the percentile rank 
was transferred to a T-score in each of the 
following measures: high-school rank, the 
Henmon—Nelson Test of Mental Ability, the 
Cooperative English Test, the American 
Council Psychological Examination, the Co- 
operative General Culture Examination, the 
Cooperative Reading Test, and the National 
Teachers Examination. In each of the various 
tests with the exception of the Henmon-— 
Nelson Test of Mental Ability (high-school 
norms), the mean of the group treated is 
slightly higher than the mean upon which the 
test was standardized. Through the T-score, 
information was lost as to the range since a 


TABLE 
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25 


percentile of 99 is considered as a T-score of 
73.3 and a percentile of one as a T-score of 
26.4. By so doing, the T-score values corre- 
sponding to decimal percentages from 99 to 
1oo and from zero to one are eliminated. 
Thus, assuming a norm distribution, the limits 
of the distribution are defined as those points 
2.32 standard deviations on each side of the 
mean. 


The distribution of the high school prin- 
cipal’s prediction of academic success, as is 
also true of the high-school personality rat- 
ings, only approximates normality. The per- 
sons considered are on the average rated as 
above the mean of high-school graduates ex- 
pecting to enter college. The lowest mean 
rating is 4.149 as compared with three as 
average. This was the princinal’s prediction. 
For the personality ratings, the lowest mean 
is 4.730 (Do others do what he wishes?) as 
compared with a rating of 3.5 as being that 
rating considered as average for all high- 
school graduates planning matriculation. 


The mean predicted grade point average is 
1.600 as compared with 1.878 for the actual 
total of four years of university work. There 
appears a tendency for grade point averages 
to rise throughout the span from the fresh- 
man through the senior year. The mean grade 
point average for all education courses is 
higher than that of either the major, the first 
minor, or the second minor; and the lowest 
grade deviates less from the mean. Of the re- 
quired courses in education (Education 73, 
74, and 75), the highest mean grade point 
average is in Education 73 though the ranges 


XXII 


Honors RECEIVED DURING INSTITUTIONAL PREPARATION For TEACHING By PERSONS 
PARTICIPATING IN THE PREDICTIVE STUDY OF TEACHING EFFICIENCY 
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STANDARD DEVIATIONS, MEANS, STANDARD ERRORS OF THE MEANS, AND NUMBER OF CASES IN THE 
DISTRIBUTIONS OF PERSONS PARTICIPATING IN THE STUDY OF TEACHING EFFICIENCY 


Measures M 
H. 8. Rank (T-Scores) 603 
H. 8. Henmon-Nelson (T-scores) 
College Henmon-Nelson (T-Scores) 
Composite Henmon-Nelson (H. S. and College) 

Scores 53. 156 


(T ) \ 
Be, POI CE, BD ncn nccccccsccnecenscccsee 4.149 
Effect of Appearance and Manners on Others 

ee 
Needs Prodding (Personality Ra  * ee 
Do Others Do t He Wishes? (Personality 


Rating H. S.) 
Control of Emotions (Personality Rating H. S.)_.... ’ 
Comets Tenn (Personality Rating H.S.)........ ,5.224 
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Interest in Teachin 

Cooperative English Test (T-Scores) 
American Council Psychological (T-Scores) 
Cooperative General Culture (T-Scores) 
Coo tive Reading (T-Scores 

National Teachers Examination (T-Scores) 
Predicted Grade Point Average 

Freshman Grade Point Average 
Sophomore Grade Point Ave: 

Freshman and Sophomore G. 

Junior and Senior G. P. A 

Four Year G. P. A 

Major G. P. A 

First Minor G. P. A 


Education 75 Practice Teaching G. P. A 
Major Practice Teaching G. P. A 
Major Final G. P. A 
Composite Practice Teaching (Education 75 and 

Major) G. P. A 
Composite Education 73-74-75 G. P. A 
Composite Education 73-74-75-Major G. P. A.._____ 
Speech Course G. P. A 
Attitude to Assigned Activity (Educ. 73) 
Ability in Assigned Activity (Educ. 73) 
Total Rating Assigned Activity (Educ. 73)________- 
Attitude to Assigned Activity (Educ. 74) 
Ability in Assigned Activity (Educ. 74) 
Total Rating Assigned Activity (Educ. 74) 3. 
Composite Educ. 73-74 Ratings in Assigned Activity.. 3. 
As a Person Rating (Education 75) 2.7 
As a Student Rating (Education 75) 
As a Leader Rating (Education 75) 
As an Advisor Rating (Education 75) 
Composite Education 75 Ratings 
As a person Rating (major) 
As a Student Rating (major) 
As a Leader Rating (major) 
As an Advisor Rating (major) 
Composite Rating in Major 
As a Person Rating 

(Composite major—Education 75)________- 


:136 
2.959 


62. 
49.000 10.057 
56. . 
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TABLE XXIII—Concluded 


Measures 
As a Student Rating 
(Composite major—Education 75) 
As a Leader Ra 
(Composite major—Education 75) 
As an Advisor Rating 
(Composite major—Education 75) 
Total Major—Education 75 Ratings 
Professional Judgment (Composite two Interview 


Sociability (Composite two Interview Ratings) 

Work Habits (Composite two Interview Rati: 

Motivation and Values (Composite two Inte: 
Ratings) 

Originality, Creativity, Initiative (Composite two 
Interview Ra ) 

General Impressions(Composite two Interview 
Ratings) 


Composite Interview Ratings (Six Preceding Items) - 


Prediction Director of Learning (B) 
Objective Data Prediction (B) 
Personal Data Prediction (E) 
Objective Data Prediction (E) 
Composite Prediction (E) 

Composite (B-E) Objective Prediction 
Major Department Prediction 


of Education 73 and 75 are the same. The 
lowest grade in these courses was a D made 
by one person in Education 74. Average 
grades in practice teaching in the major are 
higher than in Education 75 where the prac- 
tice teaching is done in the minor field. 

There is a possible range of zero to four in 
the ratings given in the assigned activities of 
Education 73 and 74. However, the lowest 
rating was 1.80. On the average, the indi- 
viduals considered are rated as above average 
both in attitude toward the assigned activity 
and in ability in the assigned activity. 

Ratings made in practice teaching in Edu- 
cation 75 are on the average lower than the 
equivalent ratings made in practice teaching 
in the major and theoretically deviate farther 
from the mean. However, the persons consid- 
ered are in general rated above average on all 
divisions of the rating sheet, that is, as a per- 
son, as a student, as a leader, and as a pros- 
pective adviser. 

With a possible range of one to five in the 
interview ratings, the actual range of the 
ratings is 2.00 to 5.00. A rating of three, then, 
is considered as average; thus, the mean 
rating on each of the six divisions of the inter- 
view is above average, the lowest being 3.2. 
The aspects evaluated were: professional 
judgment; sociability; work habits; motiva- 
tion and values; originality, creativity, and 
initiative; and general impressions. 


Ea 
. 683 
- 690 


- 645 
. 597 


ZaSASeass £ F SSF 
pore rere re pepepese 
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The prediction of educational staff member 
E as to probable efficiency as teachers, rates 
this group as very little below average using 
objective data, subjective data, or a combina- 
tion of the two collected during institutional 
preparation for teaching. Staff member B’s 
prediction was average plus based on the 
objective data while the major department 
made an average prediction of above average. 


II.4. DESCRIPTION OF THE CRITERIA USED 


Inasmuch as this report includes predic- 
tions of two separate but related investiga- 
tions, different criteria are employed in each 
study. In Study One, an effort is made to 
predict admittance to the School of Educa- 
tion, University of Wisconsin, at the begin- 
ning of the junior year while in Study Two, 
the prediction of subsequent teaching effici- 
ency after being graduated is attempted. The 
criteria of each study will, therefore, be 
treated separately in this exposition. 


II.41. THe Crirer1A EMPLOYED IN THE 
PREDICTION OF ADMITTANCE TO THE 
ScHOOL OF EDUCATION 


The criteria of this study, though statisti- 
cally related, are of two types: (1) a com- 
posite of university freshman and sophomore 
grade point averages and (2) the dichotomous 
series of being admitted or not being admitted 
to the School of Education, University of 
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Wisconsin, at the beginning of the junior 
year. Assuming that the dichotomous trait is 
normally distributed and continuous and that 
the relationship between the two factors is 
linear, the biserial coefficient of correlation 
was found between the two above mentioned 
criteria employing the method given in Ap- 
pendix E.1.* A correlation of .goz2 + .044 
was found using a distribution of 104 women 
and .£817 + .o85 using a distribution of 54 
men. Both correlations are significant at less 
than the one per cent level. 


To arrive at the composite of freshman and 
sophomore grade point average, the grade 
point averages were computed by semesters 
using the following numerical evaluations for 
letter grades: A = 3 grade points, B — 2 
grade points, C == 1, D = o, and F = —. 
For those persons who withdrew or were 
dropped from the University, the assumption 
was made that had they continued course 
work, their grade point average would have 
been the same during the time from with- 
drawal to the end of the sophomore year as 
it was to the time of discontinuing institu- 
tional preparation for teaching. Thus for 
these persons, the composite of freshman and 
sophomore grade point average is not the 
actual but rather a relative average based on 
work completed. 


The dichotomous series of being admitted 
or not being admitted to the School of Edu- 
cation is one beycnd the control of the inves- 
tigator since it is a matter of University rec- 
ords and results from certain requirements 
established which :nust be met prior to being 
admitted to the School of Education. In this 
also lies the basis for the high relationship 
found between the two criteria for according 
to the requirements:* 


. . . Students electing a teaching major 
in an academic field are eligible to transfer 
to the School of Education when they have 
satisfactorily completed the regular require- 
ments of the first two years of one of the 
General Courses in the College of Letters 
and Science. However, no student will be 
accepted into the School of Education un- 
less his academic record is sufficiently high 
to indicate the probability of success in 
some teaching field. . . . 

* See original thesis on file, Library, University of Wisconsin. 
2School of Education, “Announcement of Courses, 1944- 


1946,”" Madison, Wisconsin: Bulletin of the University of 
Wisconsin, November, 1944. 
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The unwritten rule concerning academic 
standing for the two years prior to admission 
to the School of Education is that the student 
must earn 58 credits and 73 grade points or 
60 credits and 75 grade points depending 
upon which pre-education sequence is fol- 
lowed. Since this is one of the major require- 
ments for admission, grade point average 
should be significantly related to admittance 
to the School of Education at the beginning 
of the junior year. However, admittance also 
takes place at another level. Students select- 
ing Art or Physical Education as their major 
field of concentration register in the School of 
Education at the beginning of the freshman 
year. The general admission requirements of 
the University constitute the only selective 
determinant for students in these fields since 
the students electing these two areas enter 
upon a course which stresses their special field 
throughout the four years of university work. 

Each student admitted to the School of 
Education is also required to pass speech and 
hearing tests, which include pitch determina- 
tion, high frequency, hearing ability, pronun- 
ciation, and general speech ability. Students 
with defects in speech and/or hearing may be 
denied admission, may be required to take a 
basic speech course, or may be referred to the 
speech clinic for further diagnosis and reme- 
dial treatment. 

Health examinations are likewise given. 
These examinations are of two types, “(a) 
psychiatric examination for a selected group 
at the beginning of the junior year and (b) a 
general health examination during the stu- 
dent’s senior year.” 


II.42. THe CriteERIA EMPLOYED IN THE 
PREDICTION OF TEACHING EFFICIENCY 


The major criterion employed in the pre- 
diction of teaching efficiency is a composite of 
five ratings by persons who visited the teacher 
in the school in which she was located and 
evaluated her teaching, using the M-Blank, 
Data for Individual Staff Members, 1940 edi- 
tion, and Cooperative Study of Secondary 
School Standards (Appendix A.12 and A.13).* 
A second criterion is that of pupil evaluations 
of the efficiency of the teacher, and a third, 
separate from the other two, is the residual 
gain made in 28 different classes in the sub- 

* School of Education, University of Wisconsin, Wisconsin 
Study of Teaching Ability, Unpublished Report of the Teacher 
Personnel Research Committee, 1944. 

* See original thesis on file, Library, University of Wisconsin. 
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TABLE XXIV 


INTERCORRELATIONS AND STANDARD ERRORS OF THE CORRELATIONS AMONG 
THE SEVERAL M-BLANK RATINGS* 


Xo 


X, Staff Member L 

. 880 
. 831 
. 723 
. 835 


X, Staff Member B 

X, Educ. Methods_-_--------- 
X. State Dept 

X; Prin.-Supr 


Xi 


. 880 
(. 030) 
1.000 


. 760 1. 000 
. 656 
. 583 
- 600 


X; 
. 831 
(. 047) 


656 
085) 
61 


X« 

. 723 
(. 084) 
. 583 
(.117) 
. 528 
. 132) 
- 416 
(. 165) 
1. 000 


. 568 


Xs 

. 880 
(. 031) 
- 760 
(. 057) 


- 661 


* Numbers in parentheses are standard errors of the‘correlation. 


ject areas of English, biology, civics, social 
science, and general science. Each of these 
criteria is treated separately in the report 
which is to follow both in terms of the de- 
velopment of the respective criterion and in 
the study of the relationships with which we 
are here concerned. 

Besides these measures, certain other meas- 
ures of the teacher were used in evaluating 
the teacher at work and the conditions under 
which she worked. More specifically, these 
are the Barr—Harris Teacher’s Performance 
Record, (Appendix A.16);* Guide Sheet C 
(Appendix A.15),* a supplementary state- 
ment made by the principal, staff member B, 
and staff member L working separately in 
rating the five aspects of the teacher: (1) 
as a director of learning, (2) as a counsellor 
of pupils, (3) as a member of the school staff, 
(4) as a member of the community, and (5) 
as a person; and a rating of the situation in 
which the teacher worked made by two mem- 
bers of the staff of the Department of Edu- 
cation, University of Wisconsin, working 


separately. 


II.421.THE CRITERION OF SUPERVISORY 
RATINGS 


As explained in Section II.1, The Design of 
the Study, five persons, using the M-Blank, 
evaluated the work of the teachers, The indi- 
vidual ratings were made by: two members of 
the staff of the Department of Education, 
University of Wisconsin, for the purposes of 
this study designated as B and L; one by a 
representative of the Wisconsin State Depart- 
ment of Public Instruction; one by the prin- 
cipal or superintendent under whom the 

* See original thesis on file, Library, University of Wisconsin. 


teacher did her teaching; and one by a mem- 
ber of the Department of Educational Meth- 
ods representing the subject matter area in 
which the teacher had done the major portion 
of her work as a student. All raters did not 
rate all teachers. Staff member L rated all of 
them, staff member B rated 54, the Depart- 
ment of Educational Methods 45, the prin- 
cipal or superintendent 53, and the State De- 
partment of Public Instruction, 32. 


The final evaluations were made on a five 
point scale of 5 for outstanding, 4 for above 
average, 3 for average, 2 for below average, 
and 1 for poor or inferior. The ratings of all 
judges on each individual were then combined 
into a single composite rating with all ratings 
being assumed equivalent, that is, each rating 
receiving an equal x weighting. In doing so, 
all ratings for a particular teacher were 
summed and divided by the number of judges 
thus arriving at an estimate of efficiency still 
based on a range of from five to one. The 
intercorrelations among the several ratings 
and the composite using the Pearson-Product- 
Moment Coefficient of Correlation technique 
for ungrouped data are presented in Table 
XXIV. 


Considering that these ratings were made 
by many different raters, each observing the 
teacher rated under very different conditions 
and at different times during the year, the 
correlations are higher than might be ex- 
pected. The lowest correlation of any indi- 
vidual rating with the composite is .723 + 
.084 and with any other individual rating is 
.403 + .131. All intercorrelations are signifi- 
cant at less than the one per cent level with 
the exception of that between the ratings 
made by the Department of Educational 
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TABLE XXV 


SIGNIFICANCE OF DIFFERENCE OF MEANS AND VARIANCES OF EacH SuBJECT GROUP AS COMPARED 
WITH THE ToTAL Group MINUS THE SUBJECT GROUP 


— Group 


Bnelish and Speech 
History and Social Science 
Home conomiecs _ _ - - 


Methods and the State Department which is 
significant at less than the five per cent level. 
This apparent relative agreement may be 
attributable to the fact that a single rating 
scale was used by all and that the ratings 
were preceded by a period of training for the 
judges. The reliability of the criterion deter- 
mined by the chance halves method using the 
Spearman—Brown prophecy formula‘ is .862. 

A comparison might well be made between 
the composite M-Blank ratings made in each 
field of teaching. There were five persons 
teaching art, 16 teaching English and speech, 
five history and social science, 23 home eco- 
nomics, four music, and five in the miscella- 
neous grouping. Using the equation for the 
critical ratio between means, 


CR. aE, 
V Emi? + Ems? 
it is found that no differences between the 
means of respective divisions and the mean of 
the remainder of the group is significant at 
even the five per cent level. 

Using the F test for variances presented by 


2 
Pall with the ex- 


ception of the music group can be said not 
to vary significantly from the remainder of 
the group at the one per cent level. Should 
the five per cent level be considered signifi- 
cant, then the art, English and Speech, and 
music groups may be considered significantly 
different than the rest of the group. In each 
case, the group under consideration is elim- 
inated from the total group, that is, the dif- 
ference is found between the music group and 
the total group minus the music group (Table 
XXV). 


*C. W. Odell, An Introduction to ac Statistics 
(New York: Prentice-Hall, 1946), p. 15 

5 George W. Snedecor, Statistical Meiko (Ames, Towa: 
Collegiate Press Inc., 1940), pp. 183— 





Snedecor,® where F —= s 


Variance 
5% level 
2. 56 
2.21 
5. 70 
1.95 
2.79 
2. 56 


Mean 

C. R. F 

. 855 2.915 
. 767 2.995 
. 459 1. 878 
. 322 1. 605 
. 341 5. 927 
. 233 1. 220 


1% level 


3.72 


In visiting the teachers, staff member B 
also made an evaluation of 54 of the teachers 
using the Barr—Harris Teacher’s Performance 
Record. The correlation with the criterion of 
composite supervisory ratings is .758 + .o58. 
This correlation may be spurious since both 
ratings were made by the same person as the 
result of the same observation. However, the 
relationship does show high reliability in the 
rater. 

As stated previously, the principal, staff 
member B, and staff member L made supple- 
mentary ratings using Guide Sheet C. As was 
the case in the M-Blank, ratings of 5, 4, 3, 2, 
and 1 were given for outstanding, above aver- 
age, average, below average, and poor respec- 
tively. The evaluations for each of the four 
divisions, that is, the teacher as a director of 
learning, as a counsellor, as a member of the 
school staff, and as a member of the commu- 
nity, were combined into a composite rating 
for each teacher in each division. A composite 
was then made of all divisions. The correla- 
tions between each division and the composite 
with the criterion of supervisory ratings are 
found to be statistically significant at less 
than the one-hundredth of one per cent level. 
The correlations with the criterion follow: 
composite director of learning, .810 + .046; 
composite counsellor, .667 + .074; composite 
member of school staff, .558 + .091; com- 
posite member of community, .652 + .076; 
and composite of the total, 801 + .047. This 
would indicate reliable raters though it does 
not necessarily mean that the ratings are 
valid. The intercorrelations of the five divi- 
sions of Guide Sheet C based on 58 cases is 
presented in Table XXVI. All correlations are 
significant at the one per cent level or below. 

Thirty-nine of the 58 teachers were located 
in a teaching position in Wisconsin a second 
year (1944-45). Copies of the M-Blank 
and Guide Sheet C were sent to their re- 
spective principals with the request that 
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TABLE XXVI 
INTERCORRELATIONS AMONG THE DIVISIONS OF GUIDE SHEET C 


Member of Community 
Composite 1-4 


Xi 
Xs 
Xs 
X4 
Xs 


a rating be made of the efficiency of the 
teacher on each. Pearson-Product-Moment 
correlations were then computed using 34 
teachers for whom the ratings were received. 
The correlation between the principal’s 
M-Blank evaluations for 1943-44 and 1944- 
45 is .204 + .169; between his M-Blank 
evaluation for 1944-45 and the composite 
M-Blank 1943-44 is .271 + .161; between 
his M-Blank evaluation for 1944-45 and his 
rating on Guide Sheet C for 1944-45 is 
.770 + .071; between the composite M-Blank 
rating of 1943-44 and the principal’s rating 
on Guide Sheet C for 1944-45 is .369 + .150; 
and between the principal’s evaluation on 
Guide Sheet C for 1943-44 with his evalua- 
tion on the same blank in 1944-45 is .287 + 
.160. 

The only correlations which are significant 
at even the five per cent level are: composite 
M-Blank rating 1943-44 with principal’s 
rating on Guide Sheet C 1944-45, and prin- 
cipal’s rating on M-Blank 1944-45 with prin- 
cipal’s rating on Guide Sheet C 1944-45, 
which is highly significant. 

The difference between the ratings of 1943— 
44 and 1944-45, as presented, might be due 
to one cause or several causes in combination. 
In the first place, twelve of the teachers 
changed teaching positions at the end of the 
first year and were therefore rated by a differ- 
ent principal the second year; and in the sec- 
ond place, the quality of teaching may have 
changed with some teachers improving in 
efficiency more rapidly than others; and 
thirdly, correlations in two examples are run 
with composite evaluations of 1943-44 in- 
stead of with the principal’s rating taken sep- 
arately. It is worthy of note, however, that 
the principals doing the rating were measur- 
ing to great degree the same qualities in using 
the M-Blank and Guide Sheet C in 1944-45 
(r = .770 + .071). 

Worthy of note also in respect to the cri- 
terion of supervisory ratings, is the evaluation 
of the difficulty of the situation in which each 


- 803 


X4 

- 567 
- 622 
. 758 
1. 000 
. 868 


Xs 
. 746 


Xs 

. 416 
. 560 
1.000 
. 758 
. 197 


622 
. 886 


teacher worked made separately by the two 
members of the Department of Education, 
staff member B and staff member L. The cor- 
relation between the composite of the two 
ratings of the situation with the criterion is 
—.337 + .118. This is a significant correla- 
tion at the one per cent level and is negative 
as it should be indicating that the teachers in 
the less difficult situations are given higher 
efficiency ratings than teachers in the more 
difficult situations. The evaluation of the situ- 
ation was made on a five point scale from one 
to five with one being the least difficult, three 
being average, and five being very difficult. 
To determine the reliability of the situation 
rating, staff member B who made his initial 
rating in May, 1944, was asked to again eval- 
uate the difficulty of the situation for each 
teacher. This final evaluation was made in 
August, 1944, on the basis of materials col- 
lected for the May rating. The correlation 
between the two ratings is .669 + .074. 


II.422. THE CRITERION OF PuPIL 
EVALUATION 


A number of pupils (usually five or six) 
taught by each teacher was asked to estimate 
the teacher’s efficiency in comparison with 
the other teachers under whom they worked. 
The directions for the unsigned written eval- 
uation of the strengths and weaknesses of 
each teacher follows: 


You are now in several different classes 
or courses taught by several different teach- 
ers. I am visiting Miss X and she is one of 
your teachers. You can help us train teach- 
ers at the University of Wisconsin by tell- 
ing us how good she is or bad she is, which- 
ever is the case. What you write on your 
paper is strictly confidential; it will be seen 
by no one else but me. Now think over the 
list of different teachers from whom you are 
now receiving instruction. Write down the 
number of different persons from whom you 
are now receiving instruction. If Miss X is 
the best of these several instructors write 
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down a number 1 and draw a circle around 
it; if she is second best, that is you can 
think of one better, write down a figure 2 
and draw a circle around it; and so on. If 
she is the poorest simply write the word 
last or poorest. If I may have your paper 
now I will put it here in this large envelope 
and seal it. I appreciate your assistance. 


Some pupils had three teachers, some four, 
and some five. The ranks were all transmitted 
to a five step scale with values of 5, best; 4, 
next best; et cetera. The several ratings for 
each teacher were then averaged for a single 
composite score. This last named composite 
score is that used as the criterion of teaching 
efficiency employing pupil evaluations. 


II.423. THE CRITERION OF RESIDUAL 
Puprt GAIN 


A third and final criterion of teaching effi- 
ciency employed in this investigation is that 
of measured pupil achievement. Standardized 
tests were given to the pupils in 28 classes 
taught by 18 teachers, roughly at the begin- 
ning and end of the second semester of the 
1943-44 school year. The 28 classes tested 
included four classes in biology, four in civics, 
ro in English, five in social science, four in 
general science, and one in Spanish. Samples 
of the tests administered can be found in 
Appendix D.2 to D.8.* They are: 


Biology—The Wisconsin Achievement 
Tests, Biology, Form A, 1939, Eau 
Claire, Wisconsin: E. M. Hale and Co. 

Civics—Wrightstone Scale of Civic Beliefs, 
Form A, Grades 9 to 12, 1938, New 
York: World Book Co. 

English—American Council on Education 
Cooperative English Test, Test A: Me- 
chanics of Expression, Form T, 1943, 
New York: Cooperative Test Service. 
American Council on Education Cooper- 
ative English Test, Test B2: Effective- 
ness of Expression (Higher Level), Form 
T, 1943, New York: Cooperative Test 
Service. 

Social Science—American Council on Edu- 
cation Cooperative General Achievement 
Tests, Revised Series, 1. A Test of Gen- 
eral Proficiency in the Field of Social 
Studies, Form T, 1942, New York: Co- 
operative Test Service. 

* See original thesis on file, Library, University of Wisconsin. 
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General Science—The Wisconsin Achieve- 
ment Tests, General Science, Form A, 
1939, Eau Claire, Wisconsin: E. M. Hale 
and Co. 


Spanish—American Council on Education 
Cooperative Spanish Test, Form P, New 
York: Cooperative Test Service. 


The tests were administered by the prin- 
cipal or by the teacher under his supervision 
and were scored by the Teacher Personnel 
Research Committee. Since there was only 
one teacher instructing in Spanish and there- 
fore comparisons could not be drawn, this 
teacher was eliminated leaving 17 teachers 
and 27 classes in this part of the investiga- 
tion. 


A series of steps were taken in arriving at 
the criterion of residual pupil gain (See 
Appendix D.1).* The mean raw score gains 
for each class were first computed by sub- 
tracting the mean of the class on the initial 
test from the mean of the class on the final 
test. This gain was then divided by the num- 
ber of months carried to three decimal places) 
between tests to give an average raw score 
gain. The mean and standard deviation of 
the raw score gains for all classes in any divi- 
sion, as , for example, four in English, were 
determined and from these the z-score gain 
was calculated. The z-scores for the pre-tests 
were also computed for each class in the sub- 
ject division. 

The Henmon—Nelson Test of Mental Abil- 
ity was administered to all pupils involved. 
The z-score mental age and z-score intelli- 
gence quotient were then calculated for the 
total of each class using the means and stand- 
ard deviations based on all classes in all sub- 
ject areas. 


Zero order Pearson-Product-Moment coeffi- 
cients of intercorrelation were calculated be- 
tween the z-score gains, the z-scores of the 
pre-test, the z-scores of mental age, and the 
z-scores of intelligence quotients. These inter- 
correlations are presented in Table XXVII. 


The Aitkin Modified Method with Each 
Pivot Converted to Unity® was employed in 
solving the matrix of Table XXVII thus 
arriving at an equation for predicting pupil 

* See original thesis on file, Library, University of Wisconsin. 


* Godfrey H. Thomson, The Factorial Analysis of Human 
Ability (New York: Houghton Mifflin Co., 1939), pp. 89-95 
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TABLE XXVII 
INTERCORRELATIONS AMONG THE MEASURES EMPLOYED IN PREDICTING PUPIL GAIN 


X, Average Gain 
X, 


T 
X: Mental Age 
Xs Satallignnes Quotient 


gains in terms of z-scores. The equation fol- 
lows: 

Z, == .1258, — .0522, + .1682,, where: 
z, == predicted gain in z-scores, z, == z-score 
of the pre-test, , == z-score of mental age, 
and z, == z-score of I. Q. 


Using the above equation, the predicted 
gain for each class was calculated. The crite- 
rion of teaching efficiency was obtained by 
subtracting this predicted gain from the 
actual gain to give a residual gain for each 


TABLE XXVIII 


THE RESIDUAL GAIN SCORES EMPLOYED IN THE 
PREDICTION OF TEACHING EFFICIENCY 
BASED ON PUPIL GAIN* 


Criterion Scores 
(z-score +-2) 
400 
840 
982 
057 
192 
127 
257 


Teacher No. 


me © 
ae § 

1. 
-2. 
2. 
= 
- } 
- 2 
ioke 


' ‘ ' ' 
' ohobebebobebs 


*In all calculations, the criterion was rounded 
to two decimals. 


class (Appendix D.1).* If a teacher had 
two or more classes which were tested, a 
mean residual gain of the combined classes 
was computed by adding the residual gains 
and dividing by the number of classes. Thus 
17 residual gain scores were arrived at repre- 
senting the gains attributable to the 17 
teachers and other uncontrolled factors. These 
residual gains with a constant of two added 
to make them all positive is then the crite- 
rion of teaching efficiency which was used. 
(See Table XXVIII). 

* See original thesis on file, Library, University of Wisconsin. 


Xs 

. 103 
. 126 
1.000 
. 382 


Xi 


II.43. COMPARISON OF THE THREE CRITERIA 
oF TEACHING EFFICIENCY 


The relationship between the three criteria 
of teaching efficiency is presented in Table 
XXIX. According to McCormick,’ assuming 
a five per cent significance level, of the inter- 
correlations of the various criteria only that 
between pupil evaluation and the composite 
M-Blank is significant. If the various’ ratings 
of the M-Blank are correlated with the pupil 
evaluation, that rating made by the Depart- 
ment of Educational Methods is related to 
pupil evaluation to greater degree than can be 
attributed to chance alone at the five per cent 
level (r == .311 + .139). 

These correlations, in general, indicate that 
whatever is being measured by each of the 
types of criteria the criteria are not, in gen- 
eral, measuring the same aspects of teaching 
efficiency, Particularly, is this true in respect 
to the criterion of residual pupil gain. 

Correlations of divisions of the various cri- 
teria with divisions of the other criteria will 
be treated to greater degree in Section IV. 
Reference is made also to the criterion evalu- 
ation of the individual teachers presented in 
Appendix E.* 


SECTION III 


PREDICTION STUDY ONE: THE PRE- 
DICTION OF ADMITTANCE TO THE 
SCHOOL OF EDUCATION, UNI- 
VERSITY OF WISCONSIN, AT 
THE BEGINNING OF THE 
JUNIOR YEAR 


The major purpose of the investigation here 
reported is to discover means by which valid 
and reliable predictions might be made of 
success in being admitted to the School of 
Education, University of Wisconsin, at the 
beginning of the junior year of institutional 
education. A secondary purpose is to compare 
predictions of grade point averages for per- 

7 Thomas C. McCormick, Elementary Social yey | (New 
York: McGraw-Hill Book Co., 1941), p. 306, Table 4. 

* See original thesis on file, Library, University of Wisconsin. 
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TABLE XXIX 
INTERCORRELATIONS OF THE CRITERIA OF TEACHING EFFICIENCY* 


X, Composite M-Blank 
X, Pupil Evaluation _- 


X; Pupil Gain Residual saaion ee 
* Numbers in parentheses are standard errors of the correlations. 


sons interested in teaching with the prediction 
made by the staff of the registrar, University 
of Wisconsin, for the University as a whole. 

Only data available at the end of Freshman 
Orientation Week are used in this prediction 
since the results of this study may be of use 
in guidance and recruitment programs. 

Persons are considered who were graduates 
of Wisconsin high schools, who expressed 
teaching as their first choice of occupation on 
the University of Wisconsin Application for 
Admission blank, and who entered the Uni- 
versity of Wisconsin in 1939. 

The following measures were employed: 


1. Percentile rank in high-school class. 

2. Percentile rank on the Henmon—Nelson 
Test of Mental Ability (high-school norms). 

3. Hours of home study during the senior 
year of high school. 

4. Total siblings in family. 

5. High-school principal’s prediction of aca- 
demic success. 

6. High-school personality ratings: 

a. How does his appearance and manner 

affect others? 

. Does he need constant prodding or does 
he go ahead with his work without being 
told? 

. Does he get others to do what he 
wishes? 

. How does he control his emotions? 

. Has he a program with definite pur- 
poses in terms of which he distributes 
his time and energy? 


7. Percentile rank on the Henmon—Nelson 
Test of Mental Ability (college norms). 

8. Percentile rank on the American Council 
on Education Cooperative English Test. 

9. Percentile rank on the American Council 
on Education Psychological Examination for 
College Freshmen. 

10. Predicted grade point average. 

11. Intelligence quotient. 


Xi X; 

. 279 
(. 130) 
1. 000 


. 055 


. 279 
. 193 


Percentile ranks, as appear above, were em- 
ployed in this investigation for two reasons: 
first, because only percentile ranks are avail- 
able in the records of the University and, 
second, in order that comparisons can be 
drawn between the prediction made in this 
study and the prediction of grade point aver- 
age made by the University. (See prediction 
equation for grade point average, Section 
IT.2). 

The criteria of this study are of two types: 
(1) the dichotomous series of being admitted 
or not being admitted to the School of Edu- 
cation at the beginning of the junior year, and 
(2) a composite of freshman and sophomore 
grade point averages. In the latter criterion, it 
was necessary, in case a person withdrew prior 
to the junior year, to use the grade point 
average up to the time of discontinuance of 
studies as an index of grade point average 
for the two-year period. With this limitation, 
200 individuals, 55 men and 145 women, are 
considered. 

Employing the dichotomous criterion, all 
persons who were graduated in fields other 
than teaching and who did not enter the 
School of Education at the beginning of the 
junior year were eliminated. This was neces- 
sary since these persons may have been ad- 
mitted had they applied for admission. 

Men and women are treated separately. 
For description of the samples and division 
as to sex, reference is made to Section II.31. 


III.1. PrepicTIoNn or BEING ADMITTED BASED 
ON THE DicHoTOMOUS SERIES OF BEING 
ADMITTED OR Not Betnc ADMITTED 


The first step taken in this analysis was to 
calculate the biserial coefficients of correlation 
between the several variables and the crite- 
rion of being admitted to the School of Edu- 
cation (See Appendix E.1).* The assumption 
was made that the dichotomous trait is nor- 
mally distributed and continuous and that all 

* See original thesis on file, Library, University of Wisconsin. 
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TABLE XXIXa 


BISERIAL CORRELATIONS AND STANDARD ERRORS OF THE CORRELATIONS BETWEEN THE VARIABLES 
AND THE CRITERION OF BEING ADMITTED TO THE SCHOOL OF EDUCATION 


Measures 


Intelligence Quot. (H. S.)_ -- 
Percentile Hen.-Nels. (College) - 
Percentile Hen.-Nels. (Sr. H. S.)- 
Perc. Rank H. S. Class___- 
Perc. Eng. Cooperative ; 
Perc. Am. oe Psy. Exam.. 


Pred. G. P. A 
Fresh. and Soph. G. P. A. 


Prin. Pred. ( 
Personality Rat. —Appearance- 


Personality Rat.—Prodding - 

Personality Rat.—Others Do What He Wishes 
Personality Rat.—Emotions_. 

Personality Rat.—Purpose 

Total Siblings - 

Hrs. Home Study (Sr. H. S.) 


relationships are linear. The coefficients of 
correlation with their standard errors are pre- 
sented in Table XXTXa. 

The coefficients of correlation of the sam- 
ples of both men and women are significant 
at the one per cent level between the crite- 
rion of admittance and the following factors: 
high-school rank, the Henmon—Nelson Test 
of Mental Ability (high-school and college 
norms taken separately), the English Cooper- 
ative Test, the American Council Psycholog- 
ical Examination, the predicted university 
grade point average, the composite of fresh- 
man and sophomore university grade point 
average, and the high-school principal’s pre- 
diction of academic success in college. Stated 
differently, the concomitant variation between 
the two series taking each variable separately 
with the criterion is more than can be attri- 
buted to chance alone at the one per cent 
level. 

All other variables for the sample of women 
are significantly related to the criterion at the 
one per cent level with the exception of total 
siblings and hours of home study during the 
senior year in high school. This is not true for 
the sample of men for other than the variables 
mentioned which are significant at the one per 
cent level. No other factor is significant at 
even the five per cent level with the exception 
of the high-school personality rating of “Does 
he get others to do what he wishes?”’. 

Though the high-school personality ratings 
for the sample of women are high (r = .448 
to r = .949) and are significant, they are not 
used for purposes of prediction since they are 
based on only one judge’s estimate in each 


Women Men 
This Erbis This 
. 5296 . 125 —-. 0793 
.4917 .101 . 4811 
. 4162 . 109 .4772 
. 7064 . 080 . 4134 
. 5964 . 091 . 3584 
. 5807 ; . 4386 
. 6943 . 4275 
. 9016 . 8174 
. 7053 . 3845 
. 9488 . 2351 
. 6137 . 3346 
. 5206 . 1508 
. 4497 . 1583 
. 6104 . 2181 

—. 2026 . 2542 

—. 1057 . 1103 


. 125 .174 
case, and the number of individual judges is 
nearly equal to the number of cases in the 
sample. From a logical standpoint, these high 
relationships may be chance relationships. 

For the sample of women, the Pearson- 
Product-Moment intercorrelations using un- 
grouped data were computed between the 
American Council Psychological Examination, 
the Cooperative English Test, and the high- 
school principal’s prediction. These were 
placed in a correlation matrix with the bi- 
serial correlations found between these factors 
and the criterion (Table XXX). 

The matrix was then solved using the 
Aitkin Modified Method with Each Pivot 
Converted to Unity’ arriving at the following 
prediction equation in terms of z-scores, 
where z, == prediction of criterion, z, == rank 
in high school class, z, == American Council 
Psychological, z, == English Cooperative, and 

, = high-school principal’s prediction: 


2, = .3492, + .0462, + .2252, + .2812,. 


The multiple correlation, R,.,2;,, is .778. 
This was obtained using the equation, 

Ros2se” = Boor + BosFor + Bosfos + 
Boo4, and is significantly different than zero 
at less than the one-hundredth of one per cent 
level. The equation for significance is: 


Sig. Level == 1 — (area under normal prob- 


ability curve at where a — the 


VN—a 
number of independent variables. 


1 Godfrey H. Thomson, The Factorial Analysis of Human 
Ability (New York: Houghton Mifflin Co., 1939), pp. 89-95. 
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TABLE XXX 


INTERCORRELATION MATRIX FoR WOMEN USING THE CRITERION OF ADMITTANCE 
TO THE SCHOOL OF EDUCATION 


X; Xs 


. 706 


X; 
- 581 
. 561 
1. 000 
. 799 
. 568 


Beta COEFFICIENTS OF MULTIPLE REGRESSION For WOMEN USING THE CRITERION OF 
ADMITTANCE TO THE SCHOOL OF EDUCATION 


Xs Am. Council Psy 
X, Eng. Cooperative. 
X, Prin. iction - 


For the beta coefficients, see Table XXXI. 

The multiple correlations are as follows: 
Rose = -741 Ros23 = -760. Both are signifi- 
cant at less than the one-hundredth of one per 
cent level. 


Should the three independent variables of 
high-school rank, the American Council Psy- 
chological, and the principal’s prediction, 
alone, be used in the multiple regression, a 
multiple correlation of .767 is obtained with 
the resulting regression equation being: 

Ro.r24 = 337%, + -2078, + .3262,. 
This is higher than R,.,., and lower than 
Ro.s286- 


For the sample of men, the high-school 
rank, American Council Psychological, Hen- 


X. 
. 3487 
- 0455 
. 2254 
. 2809 


X: 
. 5554 


X; 
. 5322 
. 0561 


mon—Nelson Test of Mental Ability (college 
norms), and predicted grade point average, 
designated by X,, X,, X,, and X,, respec- 
tively, were placed in an_ intercorrelation 
matrix with the criterion (Table XXXII) and 
this matrix was solved. 

The resulting regression equation in z-score 
form is: 


Zo == 1.1648, + .7398, + .1932, — 1.1253%,. 


From the beta coefficients of Table XXXIII, 
the multiple correlation coefficients are: R,., 
= .413, Rosie = .542, Ror2s = -585, and 
Ro.1234 == -646. As the factors are added in, 
the significance level from zero decreases from 
.24% to .0o%, the multiple correlations 
becoming more significant. 


TABLE XXXII 


INTERCORRELATION MATRIX For MEN USING THE CRITERION OF ADMITTANCE TO 
THE SCHOOL OF EDUCATION 


Am. Council Psy... 
0 Or. ( college). ). 
icted G. P. A.. 


Xo 

1. 000 
- 413 
. 439 
- 481 
- 428 


X; 

. 481 

. 298 

. 567 

1. 000 
. 426 


X; 

- 413 
1.000 
. 238 
. 298 
. 875 


Xs 

. 439 
. 238 
1. 000 
. 567 
-611 


TaBLe XXXIII 


Beta COEFFICIENTS OF MULTIPLE REGRESSION For MEN USING THE CRITERION OF 
ADMITTANCE TO THE SCHOOL OF EDUCATION 


X; 
. 280 
- 216 


Xa 

1. 164 
. 739 
. 193 


X: 
. 328 
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IIl.2. THe PrepicTion OF BEING ADMITTED 
BASED ON THE CRITERION OF COMPOSITE 
FRESHMAN AND SOPHOMORE 
GrapvE Point AVERAGE 


The zero order coefficients of rectilinear 
correlation were first calculated, using un- 
grouped methods, between the criterion and 
the various factors under consideration. These 
are presented in Table XXXIVa_ together 
with the standard errors of the correlations 
and the per cent significance levels. The rela- 
tionship between all of the variables and the 
criterion for the sample of women is very 
significantly different than zero with the ex- 
ception of hours of home study during the 
senior year of high school. This is not true for 
the sample of men, however, for high-school 
rank, the English Cooperative Test, the high- 
school principal’s prediction, and the pre- 
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dicted university grade point average have a 
significant relationship to the criterion at the 
one per cent level, the Henmon—Nelson Test 
of Mental Ability (high-school and college 
norms taken separately) is significantly re- 
lated at the five per cent level, and the Amer- 
ican Council Psychological and hours of home 
study during senior year of high school are 
not related to greater degree than can be 
attributed to chance. 

The intercorrelations for the sample of 
women were found between rank in high- 
school class, the American Council Psycho- 
logical Examination, the English Cooperative 
Test, and the high-school principal’s predic- 
tion. The matrix (Table XXXIVb) of these 
factors and the criterion was solved by the 
Aitkin Method to arrive at coefficients of 
multiple correlations and beta coefficients 
(Table XXXV). 


TABLE XXXIVa 


Zero ORDER COEFFICIENTS OF CORRELATION, STANDARD ERRORS OF THE CORRELATIONS, AND SIG- 
NIFICANCE LEVEL OF THE CORRELATIONS BETWEEN THE Meg AND THE CRITERION 
OF COMPOSITE FRESHMAN-SOPHOMORE G. P. A 


Factors 

H. S. Rank-- ap : 
Hen.-Nels. (H.S.)......________- 
Hen.-Nels. (College) 

Eng. Cooperative 

Am. Council Ps 

H. S. Prin. Pred. 


Pred. G. P. A... 


Women 


Hse 
4) 


or 

. 044 
. 073 
. 064 
. 058 
. 057 
. 058 
- 085 
. 040 


sesssses s 


to 
. hd . 


TABLE XXXIVb 


INTERCORRELATION MATRIX FoR WOMEN USING THE CRITERION OF COMPOSITE 
FRESHMAN-SOPHOMORE G. P. A 


Criterion 
H. 


Xo 
X1 
=e 
X,E 
X. 


. 572 


Xs 

. 564 
. 460 
. 761 
1.000 
. 267 


Xs 
. 565 
. 476 
1. 000 
. 761 
—. 222 


X, 

. 704 
1. 000 

. 476 

. 460 

. 754 


TABLE XXXV 


BETA COEFFICIENTS OF MULTIPLE REGRESSION FoR WOMEN USING THE CRITERION OF 
COMPOSITE FRESHMAN-SOPHOMORE G. P. A. 


X, H 


Xs 
. 537 
. 163 


X. 
1.111 
—. 583 

- 648 


Xs 





38 JOURNAL OF EXPERIMENTAL EDUCATION 


The multiple correlations obtained are: 
Ro = -704, Rose = -751, Roses = -761, 
and Ry ..34 == -702. All are significant at less 
than the one-hundredth of one per cent level, 
and each adds to the preceding with the ex- 
ception of the principal’s prediction. It would 
seem that the weighting of high-school rank 
and the American Council Psychological is as 
useful for predictive purposes as a combina- 
tion of these two with the English Coopera- 
tive. Since this is true and since the univer- 
sity grade point average is predicted by the 
staff of the registrar’s office on the basis of 
these two factors, it is possible to draw a com- 
parison between the predicted grade point 
average as a measure of being admitted to the 
School of Education and that of the Univer- 
sity as a whole. 

From the above beta coefficients, the re- 
gression equation using the high-school rank 
and American Council Psychological, desig- 
nated by z, and z., respectively becomes: 


Zo = .56162, + .29802,. 


To change this regression equation in terms 
of standard scores to a regression equation in 
which raw scores can be substituted, it is 
necessary to change the beta coefficients to 
regression coefficients. The equation then 
becomes: 


X, = .o180X, + .0081X, — .4712. 


Predicted grade point averages were de- 
rived through the use of this equation for 
each of the women in the study and com- 
pared with the predicted university grade 
point average employing the prediction equa- 
tion of the registrar’s office (See Section II.2). 
For convenience in the discussion, the predic- 
tion equation derived from this study will be 
called equation I and that of the registrar’s 
office will be called equation IT. 

Should the grade point average necessary 
for admittance to the School of Education be 
1.50, equation I predicts 75.00 per cent cor- 
rectly and equation IT, 68.48 per cent. Should 
the average necessary be 1.30, equation I cor- 
rectly predicts 80.43 per cent and equation IT, 
75.00 per cent. If the necessary average is 
lowered to 1.25 grade points, the prediction of 
equation I does not change, but the per cent 
accurately predicted by equation II increases 
to 79.35 per cent or 1.08 per cent less than 
that of equation I. This would indicate that 
with the requirement of 58 credits and 73 
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grade points or 60 credits and 75 grade points 
at present necessary for admission to the 
School of Education at the beginning of the 
junior year that the predictive value of the 
University prediction equation is as good, for 
all practical purposes, as that derived in this 
investigation. Only should the grade point 
average requirement be increased, would the 
equation of this study serve as a more accu- 
rate prediction. 


It is recalled that the multiple correlation 
derived from high-school rank and the Amer- 
ican Council Psychological Examination is 
.761. If the American Council Psychological 
Examination and the English Cooperative 
Test are used alone for the purposes of pre- 
diction, the multiple correlation is .602, which 
is lower than high-school rank alone as a 
measure (.704). However, if high-school rank 
and the English Cooperative Test are com- 
bined, the multiple correlation becomes .754, 
which is nearly as high as that of the combi- 
nation of high-school rank and the American 
Council Psychological. The equation in stand- 
ard score form when z, == predicted grade 
point average, z, == high-school rank, and 
z. == English Cooperative Test is: 


Zo == .§633, + .30532.. 


For the sample of men, percentile rank in 
high school, X,; predicted university grade 
point average, X,; the American Council Psy- 
chological Examination, X,; and the Hen- 
mon—Nelson Test of Mental Ability (college 
norms), X,, were intercorrelated and these 
intercorrelations placed in a_ correlation 
matrix with the criterion of composite fresh- 
man-sophomore grade point average, X,,, 
(Table XXXVI). Using the Aitkin method, 
the beta coefficients of Table XXXVII were 
calculated. For the various combinations of 
factors, the multiple correlations are: R,, = 
.528, Ro.12 = -529, Ro.123 = -539, and R, 1234 
== .558. The first two are significantly differ- 
ent than zero at the two-hundredths of one 
per cent level and the others are significant at 
the one-hundredth of one per cent level. 


If the high-school rank and the American 
Council Psychological are combined, the mul- 
tiple correlation, R,,,, is .534, which is sig- 
nificantly different than zero at the one- 
hundredth of one per cent level. The corre- 
sponding regression equation is: 


Z, == .5072, + .o81z,. 
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TABLE XXXVI 


INTERCORRELATION MATRIX For MEN USING THE CRITERION OF COMPOSITE 
FRESHMAN-SOPHOMORE G. P. A. 


X » Criterion 

X, H.S. Rank-. 

X, Pred. G.P.A.- : 
X, Am. Council Psy... 
X , Hen.-Nels. college 


Xo 
1. 000 
. 528 
. 478 
. 207 
. 827 


Xs 

. 207 
. 238 
.611 
1. 000 
. 567 


X: 
. 478 
. 875 
1. 000 
.611 
. 426 


Xi 

. 528 
1. 000 

. 875 

. 238 

. 298 


TABLE XXXVII 


BETA COEFFICIENTS OF MULTIPLE REGRESSION For MEN USING THE CRITERION OF 
COMPOSITE FRESHMAN-SOPHOMORE G. P. A. 


, H. 8S. Rank- 

> Pred. G. P. A... -- 
; Am. Council Psy. 
« Hen.-Nels. college - 


xX 
X 
xX 
xX 


III.3. SumMARY AND CONCLUSIONS 


It has been the principal purpose of this 
section to study certain data collectible by the 
end of Freshman Orientation Week at the 
University of Wisconsin and to determine the 
predictive value of them, taken separately or 
in combination, for ascertaining success in 
being admitted to the School of Education at 
the beginning of the junior year of institu- 
tional education. A secondary purpose is to 
compare predictions of grade point average 
for persons interested in teaching with the 
predicted university grade point average made 
by the staff of the registrar. Two criteria are 
used: (1) the dichotomous series of being 
admitted or not being admitted to the School 
of Education and (2) a composite of fresh- 
man and sophomore grade point average. 
As a result of the investigation, certain con- 
clusions seem warranted. 


1. The criterion of composite freshman and 
sophomore grade point average appears to be 
a valid measure of whether or not a person 
will be admitted to the School of Education. 
The rectilinear correlation with the criterion 
of being admitted or not being admitted is 
9016 + .044 for women and .8174 + .085 
for men. 

2. The best single measure for predictive 
purposes is the percentile rank in high-school 
class. 

3. Success in being admitted to the School 
of Education can be predicted more accu- 


X. 

. 596 
—. 156 

. 056 

. 184 


Xs 

. 735 
—. 295 

. 212 


X: 
. 467 
. 070 


rately for the group of women than for the 
group of men. 


4. There is indication that the men are 
admitted to the School of Education with a 
lower grade point average than the women. 
This may result from the fact that 29 of the 
55 men were in physical education and were 
thus admitted at the beginning of the fresh- 
man year, whereas the women taking major 
fields of specialization later were admitted at 
the beginning of the junior year when the 
requirements are more stringent. 


5. The multiple correlations when the cri- 
terion of composite university freshman- 
sophomore grade point average is used are 
slightly higher, in general, than when the cri- 
terion of being or not being admitted to the 
School of Education is employed. This may 
be due to the fact that the group used with 
the first criterion were more select than those 
used with the second since graduates in other 
fields who did not make application for ad- 
mission to the School of Education were 
eliminated. 


6. If the requirement of a 1.25 grade point 
average for admission to the School of Edu- 
cation is maintained, the prediction made 
using the prediction equation of the registrar’s 
office is, for all practical purposes, as good as 
the prediction equation with the same vari- 
ables derived as the result of this study. How- 
ever, if a higher average is necessary, up to 
1.50, the prediction equation of this study is 
superior as an instrument of selection. 
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SECTION IV 


PREDICTION STUDY TWO—THE PRE- 
DICTION OF TEACHING EFFICIENCY 
OF GRADUATES OF THE SCHOOL 
OF EDUCATION, UNIVERSITY 
OF WISCONSIN 


A primary purpose of this investigation is 
to discover means by which valid and reliable 
predictions of teaching efficiency might be 
made from data collected during the period 
of institutional preparation for teaching. 
Various data were collected concerning each 
of the 58 persons participating in this study. 
These data were brought together into a 
number of measures as follows: 


1. Rank in high-school graduating class. 

2. Henmon-Nelson Test of Mental Ability 
(high-school and college norms taken sepa- 
rately and composited). 

3. Hours of home study during senior year 
of high school. 

4. Siblings in family (younger, older, and 
total). 

5. High-school principal’s prediction of aca- 
demic success in college. 

6. High-school personality ratings in an- 
swer to the following questions: 


a. How does his appearance and manner 
affect others? 

. Does he need constant prodding or does 
he go ahead with his work without being 
told? 

. Does he get others to do what he 
wishes? 

. How does he control his emotions? 

. Has he a program with definite pur- 
poses in terms of which he distributes 
his time and energy? 


. Interest in teaching. 

8. American Council on Education Cooper- 
ative English Test (Usage, Spelling, and 
Vocabulary ). 

9. American Council on Education Psycho- 
logical Examination for College Freshmen. 

10. American Council on Education Coop- 
erative General Culture Test. 

tr. American Council on Education Coop- 
erative Reading Test C2: Reading Compre- 
hension. 

12. National Teachers Examination. 

13. Predicted university grade point aver- 


age. 
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14. Actual university grade point averages 
as follows: 


. Freshman. 

. Sophomore. 

. Combined freshman and sophomore. 

. Combined junior and senior. 

Combined for four years of college. 

Major. 

. First minor. 

. Second minor. 

Professional education courses. 

Education 73, Education 74, and Edu- 

cation 75, taken separately and com- 

bined. 

<. Composite of major and Education 73, 
74, and 75. 

. Practice teaching in the major and in 
Education 75, taken separately and 
combined. 

m. Speech course. 


SR oe oo pw 


15. Ratings in Education 73 and 74 taken 
separately and combined. 

16. Ratings in the practice teaching courses 
in the major and in Education 75. 

17. Combined impressions of two inter- 
viewers. 

18. Major department’s prediction of prob- 
able efficiency in teaching. 

19. Prediction of teaching efficiency made 
separately by two members of the staff of the 
School of Education. 

For a detailed description of the above 
measures, reference is made to Section II.2. 
The sample of 58 persons is described in 
Section IT.32. 

Three criteria of teaching efficiency are 
used: (1) a composite of five supervisory 
ratings, (2) an evaluation made by the stu- 
dents of the respective teacher under whom 
they were working, and (3) residual pupil 
gain. The relationship between and predictive 
value of the above mentioned measures, taken 
singly and in combinations through multiple 
regression technique, and the criteria are 
treated in the order in which the criteria are 
listed. The description and development of 
the criteria appear in Section II.4 together 
with other evaluations of the teacher and her 
teaching position, such as that of Guide 
Sheet C, the Barr—Harris Teacher’s Perform- 
ance Record, and the evaluation of the teach- 
ing situation. 

The first step taken in analyzing the data 
relative to each criterion after the data were 
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TABLE XXXVIII 


PREDICTION OF TEACHING EFFICIENCY 


ZERO ORDER CORRELATIONS WITH A COMPOSITE OF M-BLANK RATINGS* 


Measures 

H. S. Rank 

Comp. Hen-Nels. (H.S. and 
College)..----- 

H.S S. Henmon-Nelson 

College Henmon-Nelson 

H. S. Prin. Prediction 


H. S. Personality Rating—Affect 
of Appearance and Manner. - - 


HS. Personality Rating—Needs 
Prodding 


H. S. Personality Ratine—Do 
Others Do What He Wishes? - 


H. S. Personality Rating—Con- 
trol of Emotions 


H. S. Personality Rating—Defi- 
nite Purpose 


Comp. H. S. Personality Rating 
Siblings Younger - 

Siblings Older 

Total Siblings 

Hrs. Home Study (Sr. H. S.) - - - 
Interest in Teaching 

Interest in Teaching (rbis) 
Cooperative English Test 


Am. Council Psychological 
Cooperative General Culture - - - 
Cooperative Reading 

National Teachers Exam..-- --- 


Predicted G. P. A.- 

Freshman G. P. A. 

Sophomrre G. P. A 

Fresh. & Soph. G. P. 

Junior and Senior G. 

Four Year G. P. A. 

Major G. P. A. 

First Minor G. - A. 

Education G. P.A 

Educ. Course in Minor G. P. A. 
Second Minor G. P. A... 

Edue. 73 G. P. A. 

Educ. 74 G. P. A. 

Educ. 75 Final G. P. A.. 

Educ. 75 Practice Teaching _- 
Major Practice ae 
Major Final G. 

= Pract’ ce Teaching (Two 


Cr 


121 


Per Cent 


Conf. 
Limit 


1. 


50 


- 130 27. 57 
. 131 30.30 


. 131 29. 
. 63 


. 132 


. 156 15. 


. 152 


. 163 


-200 .158 


.482 .126 
343 1.45 
.122 .162 
.045 .164 
.120 .162 
.0382 .164 


. 146 


sats Wilh tech teed eid tak eh ath Sa ee to 
ON & & NO DODDS PD 
NWI ORO Con 


9. 


37. 


22. 


DS CO DO et Co et 


— bo wx 
> 00 co G08 


38 


85 


89 


89 


25 


. 34 
. 66 
. 93 
-61 
. 54 
. 40 
. 36 


Teachers Omitted in Correlation 
1, 16, 54 


4, 5, 8, 13, 16, 19, 21, 22, 26, 32, 
, 36, 41, 42, 44, 54, 55, 56, 57 


1,4, 5, 8, 13, 16, 19, 21, 22, 26, 32, 35, 
36, 41, 42, 44, 54, 55, 56, 5 


1, 4, 5, 8, 13, 16, 19, 21, 22, 26, 32, 35, 
36, 41, 42, 44, 54, 55, 56, 57 


1, 4, 5, 8, 13, 16, 19, 20, 21, 22, 26, 32, 
35, 36, 41, 42, 44, 54, 55, 56, 57 


1, 4, 5, 8, 13, 16, 19, 21, 22, 26, 32, 35, 
36, 41, 42, 44, 54, 55, 56, 57 


1, 4, 5, 8, 13, 16, 19, 21, z- 26, 32, 35, 
36, 41, "42, ‘44, 54, 55, 7 

1, 4, '6, 8, 13, 16, 19, 21, 28, - 32, 35, 
36, 41, 42, 44, 54, 55, 56, 

1,4, 'b, 8, 13, 16, 19, 21, 22, 26, 32, 35, 
36, 41, 42, 44, 64, 55, 56, 57 

1, 4, 5, 8, 13, 16, 19, 21, 22, 26, 32, 35, 
36, 41, 42, 44, 54, 55, 56, 57 

1,4, '6, 8, 13, 16, 19, 21, » BB, 26, 32, 35, 
4, 5, 8, 13, 16, 19, 21, 22, 26, 32, 35, 

36, 41, 42, 44, 54, 55, 56, 57 

> yt 13, 16, 19, 21, 22, 26, 32, 35, 

36, "42, 4 44, 54 

4, a8 3, 13, 16, 19, 21, 22, 26, 32, 35, 

36, 41, 42, 44, 54 

8, 13, 16, 22, ‘24, 26, 32, 35, 41, 42, 
44, 54, 56 

35, 42 

53 


»2, 
3 


1 
1, 
1, 


42 
2, 4, 5, 6, 9, 10, 11, 12, 14, 15, 16, 17, 
, 20, 21, 25, 26, 33, 38, 44, 46, 47, 

48, 49, 51, 52, 53, 55, 58 

1, 16, 35, 42, 54 

None 

None 

None 

None 

None 

None 

23, 50 

None 

3, 6, 10, 15, 22, 24, 25, 50, 55, 57 

1-5 and 22-58 (Only Eng. & Speech) 

None 

None 

None 

None 

None 

None 


None 
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TABLE XXX VIII—Continued 
Per Cent 


Measures 


Comp. Educ. 73-74-75 G. P. A. 
ome. —. 73-74-75— Major 


Speech Course G. P. A. 


Att. to Assigned Activity (73) _ - 
Abil. in Assigned Activity (73) - 


Total Rating Assign. Act. (73) 
Att. to Assigned Activity (74) 


Abil. in Assigned Activity (74) 


Total Rating Assigned Act. (74) 


Composite 73-74 Assign. Act. 


As Person (75 rating) _-_-- 
As Student (75 rating)_--_- 
As Leader (75 rating). _-_-_- 
As Advisor (75 rating) 
Composite 75 ratings 

As Person (rating in major) 


As Student (rating in major) 


As Leader (rating in major) 


As Advisor (rating in major) __._—. 


Composite Rating in Major 


As Person (comp. major— 
75 rating) __- 


As Student (comp. major- 
75 rating) 


As Leader (comp. major— 
75 rating) -_ _- 


As Advisor (comp. major- 
75 rating) 


Total Major—75 Ratings 


Pred. Dir. of Learning (B) 
Obj. Data Prediction (B) 


Personal Data Prediction (E)__- 


Obj. Data Prediction (E) - - - 


Composite Prediction (E) - - - a 


r 


. 276 


. 318 
. 069 


. 183 
. 398 
. 375 
.147 


. 203 


.015 


. 230 
. 099 
. 184 
. 201 
. 087 
. 163 


Conf. 
Cr Limit 
112 3.75 


-119 1.64 
. 168 68.18 


1.44 22.24 
126 .%6 
.128 1.10 
1.92 45.92 


. 192 


N 
58 


58 
36 


46 
46 
46 
27 


Teachers Omitted in Correlation 
None 


None 

1, 3, 4, 5, 9, 10, 18, 16, 24, 26, 27, 28, 
30, 31, 33, 39, 40, 42, 50, 53, 55, 57 

a 10, 11, 12, 19, 25, 31, 34, 37, 39, 


1,3, 10, 11, 12, 19, 25, 31, 34, 37, 39, 
1,8 10, 11, 12, 19, 25, 31, 34, 37, 39, 


1, 4, 5, 6, 7, 10, 11, 12, 18, 14, 15, 17, 
18, 19, 21, 26, 28, 29, 32, 35, 38, 40, 
>. 42, 45, 48, 49, 50, 52, 53, 54 
4, 'b, 6, 7, 10, 11, 12, 13, 14, 15, 17, 
"18, 19, 21, 26, 27, 28, 29, 32, 35, 38, 
40, 41, 42, 45, 48, 49, 50, 52, 58, 54 

1,4, 5, 6, 7, 10, 11, 12, 13, 14, 15, 17, 18, 
19, 21, 26, 28, 29, 32, 35, 38, 40, 41, 
42, 45, 48, 49, 50, 52, 53, 54 

1, 10, 11, 12, 19, 53 

11, 14, 16, 18, 20, 56 

11, 14, 16, 18, 20, 56 

11, 14, 16, 18, 20, 56 

11, 14, 16, 18, 20, 56 

11, 14, 16, 18, 20, 56 

3, 5, 6, 11, 12, 13, 14, 15, 16, 17, 18, 21, 
22, 25, 26, 31, 32, 33, 35, 36, 41, 42, 43, 
45, 46, 51, 52, 53, 55, 56, 57 

3, 5, 6, 11, 12, 13, 14, 15, 16, 17, 18, 21, 
22, 25, 26, 31, 32, 33, 35, 36, 41, 42, 43, 
45, 46, 51, 52, 55, 56, 53, 57 

3, 5, 6, 11, 12, 13, 14, 15, 16, 17, 18, 21, 
22, 25, 26, 31, 32, 33, 35, 36, 41, 42, 43, 
45, 46, 51, 52, 53, 56, 55, 57 

3, 5, 6, 11, 12, 13, 14, 15, 16, 17, 18, 21, 
22, 25, 26, 31, 32, 33, 35, 36, 41, 42, 43, 
45, 46, 51, 52, 53, 55, 56, 57 

3, 5, 6, 11, 12, 13, 14, 15, 16, 17, 18, 21, 
22, 25, 26, 31, 32, 33, 35, 36, 41, 42, 43, 
45, 46, 51, 52, 53, 55, 56, 57 


3, 5, 6, 11, 12, 13, 14, 15, 16, 17, 18, 21, 
20, 22, 25, 26, 31, 32, 33, 35, 36, 41, 42, 
43, 45, 46, 51, 53, 55, 52, 56, 57 


3, 5, 6, 11, 12, 13, 14, 15, 16, 17, 18, 20, 
21, 22, 25, 26, 31, 32, 33, 35, 36, 41, 42, 
43, 45, 46, 51, 52, 53, 55, 56, 57 


3, 5, 6, 11, 12, 13, 14, 15, 16, 17, 18, 20, 
21, 22, 25, 26, 31, 32, 33, 35, 36, 41, 42, 
43, 45, 46, 51, 52, 53, 55, 56, 57 


3, 5, 6, 11, 12, 13, 14, 15, 16, 17, 18, 20, 
33,3 25, 26, 31, 32, 33, 35, . re 42, 
43, 45, 46, 51, 52, 53, 55, 56, 

3, &, 6, 11, 12, 13, 14, 15, 16, 7 18, 20, 
21, 22, 25, 26, 31, 32, 33, 35, 36, 41, 42, 
43, 45, 46, 51, 52, 53, 55, 56, 57 

16, 40, 54 

16, 25, 40, 54 

None 

16, 40, 54 

16, 40, 54 
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TABLE XXX VIII—Continued 


Per Cent 
Conf. 


Measures r or 
Comp. (B-E) Obj. Prediction . = > 
Major Dept. Prediction -_-- .882 .121 . 
Professional Judgment (Comp 

Two Interview Ratings) - - . za es 
Social (Two Int. Ratings) .141 .182 29. 
Work Habits (Two Int. Ratings) .216 .133 12. 
Motivation and Values (Two 

3 3 ees : .383 .122 1. 
Originality, Creativity, Initiative 

(Two Interview Ratings) .174 .133 20. 
Genera! Impressions (Two Int.) .418 .111 . 
Composite Interview Ratings 

(Six Preceeding Items) _ - .312 .122 
Composite Director of Learning 

(Performance, Guide SheetC) .810 .046 
Composite Counsellor (per- 

.667 .074 
.558 .091 

munity (perf.) : .652 .076 
Composite of Total Perf. Rat- 

ings(Prin.-B-L, Guide Sht.C) .801 .047 
Barr-Harris Perf. Blank (B) .758 .058 . 
B Eval. of Teaching Situation. ._—.199 .128 13. 

1 
1 


formance) ‘ 
Composite Member School 

L Eval. of Teaching Situation .333 .118 
Comp. B-L Eval. of Situation _.—.337 .118 


Staff (perf.)__ _-. 
Composite Member Com- 
SEN, —~ BRE, 
vV (2X2 — X.2X.) (2X2 — X:2X;) 





c= 





Limit N 


Teachers Omitted in Correlation 


55 = 16, 40, 54 
51 #5, 14, 36, 51, 52, 53, 54 


56 63, 16 

56 63, 16 

52 = 3, 16, 44, 51, 53, 58 
54 3,16, 36,42 


54 3,16, 42,55 
56 «63,16 


56 «63, 16 

58 None 
58 None 
58 None 


None 


None 
19, 45, 53, 54 
45 


None 
45 
1—r 


i ————] 
VN—1 


r 
Per Cent Conf. Limit = 1 — 2 (area under normal probability curve ee 


reduced to score form, was to compute the 
rectilinear coefficients of correlation between 
the measure and the criterion using ungrouped 
data. Those measures which seemed to vary 
significantly with the criterion were then 
selected for more careful study and were used 
for purposes of prediction. 


IV.1. THE CRITERION OF SUPERVISORY Rat- 
INGS AS A MEASURE OF TEACHING 
EFFICIENCY 


The zero order correlations between the 
various measures relative to each teacher and 
the criterion of a composite of five supervisory 
ratings, the standard errors of the correla- 
tions, the per cent significance level of the 
correlation, the number of cases upon which 
the correlation is based, and the teachers 
omitted in the correlation are presented in 
Table XXXVIII. It is to be noted that these 
correlations are not all based upon the same 
number of cases because of lack of data in 


VN—1 


some areas; for example, for those persons 
who transferred to the University of Wiscon- 
sin after the first semester of the freshman 
year the materials collected during Freshman 
Orientation Week were not available. 


The coefficients of correlation between the 
following factors and the criterion are sig- 
nificantly different than zero at the two per 
cent level or below: high-school rank; high- 
school principal’s prediction; high-school per- 
sonality ratings as to definite purpose; pre- 
dicted grade point average; sophomore grade 
point average; composite freshman-sophomore 
grade point average; four year grade point 
average; first minor grade point average; final 
grade point average in the major practice 
teaching course; composite of the major and 
Education 73, 74, and 75 grade point aver- 
ages; ability in the activity and total rating 
in the activity of Education 73; each of the 
three ratings of as a student, as a person, and 
as a leader for the major and Education 75 
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combined; B’s prediction as a director of 
learning; B’s prediction of teaching efficiency 
based on objective data; the composite teach- 
ing efficiency prediction of E based on both 
objective and subjective data; the composite 
of B and E’s predictions of teaching efficiency 
based on objective data; the major depart- 
ment’s prediction of teaching efficiency; pro- 
fessional judgment, motivation and values, 
and general impressions each being a com- 
posite of the impressions of two interviewers; 
L’s evaluation of the teaching situation; the 
composite of B and L’s evaluation of the 
teaching situation; the evaluation of teaching 
efficiency made by B using the Barr—Harris 
Teacher’s Performance Record; and the com- 
posite evaluations of teaching performance 
made by the principal, B, and L using Guide 
Sheet C. 

As pointed out previously in this report, 
there is a significant relationship between the 
criterion and the composite B—L evaluation 
of the situation in which the teacher was 
located. The coefficient of correlation (—.337) 
is negative indicating that the teachers in the 
less difficult positions were given higher effi- 
ciency ratings than teachers in the more diffi- 
cult situations. There is indication, therefore, 
that accurate placement is an important 
factor in the success of a teacher. In order to 
determine to greater degree the actual effect 
of the teaching situation, partial correlations 
were computed for 19 items and the criterion 
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with the difficulty of the situation held con- 
stant. (Table XXXIX). With the exception 
of the rating of ability in the activity of Edu- 
cation 73, the magnitude of the zero order 
coefficients is increased by holding the diffi- 
culty of the situation constant. 

In the first analysis of the data, the corre- 
lations for 15 of the items seemed to be suffi- 
ciently reliable to warrant further study. 
These and the symbol by which they are 
designated were: X,, composite B—L evalua- 
tion of teaching situation; X,, high-school 
rank; X;, English Cooperative Test; X,, 
American Council Psychological Examina- 
tion; X,, Reading Cooperative Test; X,, Pre- 
dicted grade point average; X;,, composite 
freshman-sophomore grade point average; 
X,, major grade point average; X,, first 
minor grade point average; X,,, total educa- 
tion grade point average; X,,, composite of 
two practice teaching grades; X,., B’s predic- 
tion of teaching efficiency from objective 
data; X,,, prediction of teaching efficiency 
made by the major department of each stu- 
dent; X,,, a composite of two interview 
ratings on general impressions; and X,,, E’s 
prediction of teaching efficiency from subjec- 
tive data. 

The coefficients of correlation for these 15 
items range in size from .218 (the Coopera- 
tive English Test) to .473 (B’s prediction of 
teaching efficiency on the basis of test scores, 
grade point averages, and information con- 


TaBLE XXXIX 


PARTIAL CORRELATIONS For TEACHER EFFICIENCY WITH THE DIFFICULTY OF THE 
SITUATION HELD CONSTANT* 


Zero Order r 
. 331 
.218 
. 239 


Partial r 


. 360 
. 380 
. 325 
. 358 
. 410 
. 392 
. 330 
. 364 
. 328 
. 293 
- 485 
-427 
- 461 
. 336 
. 457 
. 364 
. 370 


CWOARMNIP wre 


VOOR 


_ 326 


Ti2— Tuts 
V (1 — rs") (1 — re *) 








*Hos= 


Variables 


Composite M-Blank Ratings 
H.S. Rank 


Composite Situation 
English Cooperative 
American Council Psychological 
Reading Cooperative 
Predicted G. P. A. 
Comp. Fresh-Soph. G.P.A. 
MajorG.P.A 
First Minor G. P. A. 
Education G. P. A. 
Comp. Pract. Teaching 
B Objective Prediction 
Major Dept. Prediction 
Gen. Impressions (Interview) 
= Pers. Data (E) 
H.S. Prin. Prediction 
Abil. in Activity (Educ. 73) 
Educ. Course in Major (Pract. Teaching + Final) 
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tained in the student data booklet). The first 
of these two correlations is significant at the 
15.27 per cent level, which is not sufficiently 
high to give assurance of not being a chance 
relationship. The latter may be spurious since 
the staff member making this estimate also 
contributed to the criterion as one of the five 
raters of teaching efficiency. 

It is to be noted that the highest zero order 
coefficients of correlation with the criterion 
are those of a predictive or rating nature. For 
example, the correlation between the criterion 
and a composite of two interview ratings on 
general impressions is .418 and between the 
criterion and the major department’s predic- 
tion of teaching efficiency is .382. This is 
probably as it should be since the criterion is 
one of subjective estimates. 

In considering the 15 factors previously 
mentioned, the intercorrelations were cal- 
culated and placed in a correlation matrix 
(Table XL) with the criterion. This matrix 
was then solved using Aitkin’s Modified 
Method of Pivotal Condensation. The result- 
ing beta coefficients are presented in Table 
XLI. The regression equation for all 15 items 
yields a multiple correlation of .716. This 
equation for predicting z-scores is: 


2, == —.4672, — .5072, + .2492, — .6122, 
— .0402, + 1.013%, — .2482, + .2372, 
+ .249%, — .2672,9 — .0492,, + .0742;2 
+ .2992,, + .1842,, + .2922,,. 


The significance of the multiple correla- 
tions as factors are added in, according to 
Table XLII, is measured by three methods: 
(1) the per cent significance level as deter- 
mined by the equation, sig. level == 1 — 2 
(area under normal probability curve at 

R 


—— 
VN—a 
number of independent variables; (2) the F 
test presented by Smith and Duncan,’ in 


which: 
r— R?/(k—1) 
~ (1—R*)/(N — &) 
number of regression statistics and N is the 
size of the sample; and (3) the tables of 


Ezekiel? for finding the probable minimum 


1 James G. Smith, Acheson J. Duncan, Sampling Statistics 
and Applications (New York: McGraw-Hill Book Co., 1945), 
pp. 476-479. 

2 Mordecai Ezekiel. Methods of Correlation Analysis (New 
York: John Wiley and Sons, Inc., 1930), Appendix 3, pp. 
393-398. 


) where @ = one more than the 


where & = the 





[Vol. 15, No.1 


correlation in the universe for varying ob- 
served correlations and size of sample. 

When variables two to seven, all of an 

objective nature, are considered with the eval- 
uation of the teaching situation, the multiple 
correlation is .559. This correlation is signifi- 
cantly different than zero at less than the one 
per cent level and is derived from the regres- 
sion equation; 
Zo == —.4262, — .0312, + .0373, — .1352, 
+ .1542, + .3112, + .1852,, where the vari- 
ables in respective order from one to seven 
are: (1) evaluation of the teaching situation, 
(2) high-school rank, (3) English Coopera- 
tive Test, (4) American Council Psycholog- 
ical Examination, (5) Reading Cooperative 
Test, (6) predicted university grade point 
average, and (7) composite freshman-soph- 
omore grade point average. 

If the evaluation of the situation and the 
predicted grade point average are used alone 
in that order, a multiple correlation of .512 is 
obtained with the regression equation being: 


2) == —.3832, + .3882,. 


It was thought that there might be some 
value in a prediction made in terms of high- 
school data alone so the high-school princi- 
pal’s prediction of academic success, X,; rank 
in high-school class, X,; and interest in teach- 
ing found by the Pearson-Product-Moment 
method, X,, were combined through multiple 
regression yielding a multiple correlation of 
.481. However, if the predicted university 
grade point average is used, instead of high- 
school rank, with the other two independent 
variables, the multiple correlation is increased 
to .520. It is recalled that the predicted grade 
point average is derived through multiple 
regression of high-school rank and the Amer- 
ican Council Psychological Examination per- 
centile. Ezekiel* reports a probable minimum 
correlation of .289 for a correlation of this 
size. Using the F test and the per cent sig- 
nificance level previously reported, the mul- 
tiple correlation is significantly different than 
zero at less than the one per cent level. The 
derived multiple regression equation follows: 

2, == .3412, + .2202, + .1432,, where (1) 
is the principal’s prediction, (2) is the pre- 
dicted grade point average, and (3) is interest 
in teaching. Should high-school rank and the 
composite of freshman-sophomore grade point 
average be added to the three above men- 

* Ezekiel, Ibid. 
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TABLE XLII 
SIGNIFICANCE OF THE MULTIPLE CORRELATIONS For FIFTEEN VARIABLES 


Probable Minimum 
Correlation 


.121 
. 284 


Per Cent— 
Sig. Level 
1.173 
. 040 
.013 


Variables 
Involved 
Ro. 1 
R ® 12 
* 123 
* 1234 


~ 12346 
oe 6 
+7 
- 8 
a 
* 10 
ae 
+12 
*- 13 
- 14 


-716 aE 


——= 
1°%_ indicates 1°%> sig.> 0. 


tioned items, the multiple correlation is not 
significantly changed, increasing from .520 to 
.530. 
“When the subjective items of B’s predic- 
tion of teaching efficiency, X,; principal’s 
prediction of academic success, X,; and the 
ability rating in the assigned activity of Edu- 
cation 73, X,, are combined with the rating 
of the teaching situation, X,, a multiple cor- 
relation of .642 is received. This is somewhat 
greater than the combination of six objective 
items (R == .559) previously reported. How- 
ever, the principal’s prediction may not be 
stable from one year to another since many 
different persons are making this rating. 
With the assumption that prior to the end 
of the senior year, the position into which a 
prospective teacher will go is not known, eight 
variables were combined exclusive of the 
rating of the teaching situation. The items 
representing both objective and subjective 
data are: (1) B’s prediction using objective 


.012 


. 276 
. 236 


indicates that level of significance is lower than the per cent indicated, for example, 


data, X,; a composite of two interview 
ratings on general impressions, X,; ability in 
the assigned activity of Education 73, X;; 
final grade in the major practice teaching 
course, X,; composite of Education 73, 74, 
and 75 grade point average, X,; a composite 
of freshman-sophomore grade point averages, 
X,; prediction of teaching efficiency made by 
the major department of each student, X,; 
and the high school principal’s prediction of 
academic success, X,. The intercorrelations 
for these variables and the criterion are pre- 
sented in Table XLIII while the beta coeffi- 
cients and the multiple correlations as factors 
are added in are to be found in Table XLIV. 

All multiple correlations are significant 
(Table XLV) indicating that the relationship 
found can not be attributed to chance alone. 
However, it is worthy of note that if the final 
grade in the practice teaching course of the 
major is added to the first three factors, that 
the correlation is not raised. The same is true 


TABLE XLIII 


INTERCORRELATIONS AMONG EIGHT VARIABLES, EMPLOYED IN PREDICTING TEACHING 
EFFICIENCY, AND THE CRITERION 


alalalalalalalala| 


. 338 
. 139 
. 000 ; 
306 1. 
. 214 
. 354 
. 151 
.127 
. 398 


Xe X 
. 557 
. 303 
151 
. 569 
- 402 
. 467 
. 000 ‘ 
479 = 1. 
. 382 


X; X« 
. 532 


.210 
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TABLE XLIV 
Beta COEFFICIENTS Fork THE EIGHT VARIABLES EMPLOYED IN PREDICTING TEACHING EFFICIENCy 


‘alalalalatatata! 


274 


X; 
. 273 
. 280 


X-« 

. 826 
. 297 

. 263 .279 

041 


. 103 ‘ 
—.093 —.082 
—. 090 


X« 
. 250 
. 274 
. 258 
. 056 . 089 
(.595) —.121 


X; 


* Numbers in parentheses are multiple correlations derived through the use of all factors 


up to that point. 


TABLE XLV 
SIGNIFICANCE OF THE MULTIPLE CORRELATIONS For EIGHT VARIABLES 


Variables 
R Involved 


-473 7 

. 537 12 
. 593 123 
. 595 

- 602 

- 604 

- 615 

. 650 


for the composite freshman-sophomore grade 
point average when added to the first five 
variables. 

The partial correlations previously reported 
were an indication of necessity for better 
placement of teachers since when the situa- 
tion was held constant, the coefficients of 
correlation of 18 out of 19 factors were in- 
creased. Because the teaching situation ap- 
pears so important and because it is so diffi- 
cult to determine the type of position into 
which teachers will go, it was thought advis- 
able to attempt a prediction of subsequent 
teaching efficiency, after being graduated, on 
the basis of only factors known concerning 
each individual prior to the end of the senior 
year of institutional education. If the evalua- 
tion of the teaching situation is employed as 
the last factor in the correlation matrix, it 
should be possible to determine whether or 
not as accurate predictions can be made with- 
out the use of the situation rating as with it. 
Since subjective measures seem to have 
greater predictive value than those of an 
objective sort when the criterion of a com- 
posite of supervisory ratings is used, the fol- 
lowing discussion will deal primarily with 
subjective measures. 


Per Cent— 


Probable Minimum 
Correlation 


. 276 


Four evaluations of each person were com- 
bined with the evaluation of the situation and 
the coefficients of multiple correlation were 
computed. The resulting beta coefficients and 
coefficients of multiple correlation are pre- 
sented in Table XLVI. Not only is the cor- 
relation raised in magnitude when the situa- 
tion is added in but it, also, becomes more 
significant as is discovered in examining Table 
XLVII. The multiple correlation of these five 
factors with the criterion is .680 which com- 
pares favorably with the coefficient of .716 
employing the 15 factors first reported. The 
regression equation for the five factors em- 
ployed in predicting teaching efficiency is: 


So = .1792, + .27782 + .2192, 
+ .1842, — .3112Z, 


in which the independent variables are, (1) 
B’s prediction of teaching efficiency based on 
objective data, (2) composite of two inter- 
view ratings as to general impressions, (3) 
rating in ability in the assigned activity of 
Education 73, (4) prediction of teaching effi- 
ciency made by the major department, and 
(5) composite of B and L’s evaluation of the 
teaching situation. 
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TABLE XLVI 


BETA COEFFICIENTS For FIVE SUBJECTIVE EVALUATIONS, EMPLOYED IN PREDICTING TEACHING 
EFFICIENCY, AND THE CRITERION* 


Xs Cc 
.473 
.418 
. 398 
. 382 
—. 337 


X« 
. 205 
. 255 


X, B Obj. Pred 

X. Gen. ) tem (Int) 
X; — +. (78) 
X« De 
Xs 


* Numbers in parentheses are multiple correlations derived through the use of all factors 
up to that point. 


TABLE XLVII 


SIGNIFICANCE OF THE MULTIPLE CORRELATIONS, FIVE VARIABLES 


Per Cent— Probable Minimum 
Sig. Level Correlation 
. 040 . 276 
. 007 
. 389 


- 001 
. 488 


Variables 
R Involved 
.473 Ro. 1 
. 587 Ro. 12 
. 596 Ro. 123 
. 609 Ro. 1234 
e 680 R O- 12345 


. 001 
. 000 


Four factors were employed in an attempt 
to predict teaching efficiency as follows: (1) 
composite of two interview ratings on general 
impressions, (2) rating of ability in the as- 
signed activity of Education 73, (3) final 
grade in the course of practice teaching in the 
major, and (4) the composite of B and L’s 
evaluation of the teaching situation. Through 
multiple regression R,,.;, was found to be 
.644 while R,.,., is .561. As was the case in 
the previous example, the evaluation of the 
teaching situation again contributes signifi- 
cantly. The equations for the coefficients of 
multiple correlation are: 


Ro.123" = 342%, + .300%o. + .16275; 
Ro 1234" = 359% or + -226Fo2 
+ .201%5, — 325% o4- 


If the four factors of (1) general impres- 
sions (interview), (2) ability in activity (73), 
(3) B objective prediction, and (4) B-—L 
evaluation of situation are placed in an inter- 
correlation matrix and the matrix is solved, 
the coefficient of multiple correlation 
(Ro.12s4) is found to be .660; whereas, if the 
evaluation of the situation is omitted, the cor- 
relation is only .592. However, the probable 
minimum correlation for the latter is .391 and 
it is significantly different than zero at the 
one-thousandth of one per cent level. 


Ro .s234? == -298%o, + 210g, 
+ +27 os — .2987,,. 


IV.2. THE CRITERION OF PuPIL RATINGS AS A 
MEASURE OF TEACHING EFFICIENCY 


A second criterion of teaching efficiency 
employed in this investigation is that of pupil 
ratings of their teachers. The question to 
which an answer is sought is, “Can accurate 
predictions be made from the data collected 
relative to each student while in attendance 
at the University of Wisconsin as to whether 
she will be considered a good teacher by the 
pupils in her classes?” In order to secure in- 
formation in answer to this question, the 
Pearson-Product-Moment coefficients of recti- 
linear correlation were computed, using un- 
grouped data, between the criterion of pupil 
ratings and 34 items of information concern- 
ing each teacher as a student. These together 
with the standard errors of the correlations, 
the per cent confidence limits of the correla- 
tions, the number of cases, and the numbers 
of the teachers omitted in each correlation are 
presented in Table XLVIII. 


It would seem, from an examination of 
these data, that it is more difficult to predict 
student opinion than it is to predict super- 
visory ratings. There are no coefficients of 
correlation which are significantly different 
than zero at the one per cent level. The rela- 
tionships between the criterion and the Coop- 
erative General Culture Test and the Cooper- 
ative Reading Test are significant at the two 
per cent level. Only the concomitant varia- 
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Measures 


Comp. Henmon-Nelson (H. S.- 
College) ; 
Coop. English Test 


Am. Council Psychological 
Coop. General Culture 

Coop. Reading Test_________-- 
Nat. Teacher’s Exam.. - - ---- 


Predicted G. P. A 

Comp. Fresh. Soph. G. P.A. 

Comp. Jr-Sr. G. P. A.. — 

Total G. P. A. (Four yrs.)_. ceokel 

G. P. A. in Major , 

First Minor G. P. A._ ---- 

Total Educ. G. P. A 

Comp. Educ. 73-74-75—major 
ty ® 

Comp. Two Pract. Teaching 
Grades P — 

Comp. Educ. 73-74 Ratings. Bes 

As Person (Educ. 75 Rating) - - 


As Student (75 Rating) - - - 


As Leader (75 Rating) 
As Advisor (75 Rating) 
Total Rating Educ. 75 


Prof. Judgment (Interviews) ___- 
Sociability (Interviews) - 
Work Habits (Interviews) 


Motivation & Values (Inter.)_--- 
Originality, Creativity, Initia- 

tive (Interviews) 
Gen. Impressions (Interviews) - - 
Comp. Interview Ratings -- - --- 
Pred. from Pers. Data (E) 
Pred. from Objec. Data (E)__..— 
Comp. Prediction (E) 
Pred. of Major Dept 


Pred. from Objec. Data (B)___-- 
Barr-Harris Performance Blank- 
Comp. M-Blank 


State Dept. M-Blank-------- 


Prin. or Supt. M-Blank , 

B. Eval. of Teaching Situation .—. 256 

L Eval. of Teaching Situation _.—. 242 

Comp. B-L Eval. of Teaching 
Situation 
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TABLE XLVIII 
ZERO ORDER COEFFICIENTS OF CORRELATION WITH PUPIL EVALUATIONS OF TEACHING EFFICIENCy 


Per cent 
Conf. 


Er, Limit 
. 144 67.45 


.134 8.91 
-147 5.24 


. 142 39.53 
-125 1.78 
-126 1.73 
.178 13.10 


. 147 
.141 
.141 
.141 
-141 
. 144 
. 139 


1.38 
.141 
.141 
- 147 


- 145 


. 145 


N 
48 


49 
37 


48 
50 
49 
26 


= £38 8 Sesssss 


ss 
_ 
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Teachers Omitted in Correlation 
1, 2, 9, 12, 15, 16, 45, 53, 54, 19 


Bo Be Se ee SG, 58, OS SS 

1,2, 8, 9, 12, 13, 15, 16, 19, 22, 24, 26, 32, 

eM 42 44, 45, 53, 54, 56 

1? , 19, ‘35, 42, ‘45, ‘3, 54 

12, 18. 19, 45, 53, 54 

12, 15, 19, 42, 45, 53, 54 

5, 6, 9, 10, 11, 12, 14, 15, 16, 17, 18, 

20, 21, 25, 26, 33, 38, At Ns 46, 47, 
, 49, 51, 52, 53, 54, 5 

2°, 12, 15, 16, 19, 35, re 45, 3, 54 

1?, 15, 19, 45, 53, 54 

12, 15, 19, 45, 53, 54 

12, 15, 19, 45, 53, 54 

1 

1 


’ 


nnn. 


2, 15, 19, 45, 53, 54 
, 12, 15, 19, 23, 45, 50, 53, 5 
12, 15, 19, 45, 53, 54 


2, 15, 19, 45, 53, 54 
5, 19, 45, 53, 54 


10, 11, 12, 15, 19, 45, 53, 54 
2, 14, 15, 16, 18, 19, 20, 45, 53, 


toeKerm rw porr 


12, 14, 15, 16, 18, 19, 20, 45, 53, 
2, 14, 15, 16, 18, 19, 20, 45, 53 
2, 14, 15, 16, 18, 19, 20, 45, 53, 
2, 14, 15, 16, 18, 19, 20, 45, 53 
19, 45, 53, 54 

, 19, 45, 53, 54 

6, 19, 44, 45, 51, 53, 54, 

, 9, 12, 15, 16, 19, 36, 42, 45, 53, 54 

9, 12, 15, 16, 19, 42, 45, 53, 54, 55 

3, 9, . 15, 16, 19, 45, 53, 54 

2, 15, 16, 19, 45, 53, 54 


9, 
13, 15, 19, 45, 53, 54 

12, 15, 16, 19, 40 ,45, 53, 54 
1 

9 


mm nw wo 


, 16, 
, 16 
» i 


torr pr 
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pore 


2; 15, 16, 19, 40, 45, 53, 54 
, 12, 14, 15, 19, 36, 45, 51, 52, 53, 


12, 15, 16, 19, 25, 40, 45, 53, 54 

12, 15, 19, 45, 53, 54 

12, 15, 19, 45, 53, 54 

12, 15, 19, 45, 53, 54 

12, 15, 19, 24, 45, 53, 54 

9, 12, he 19, 24, 26, 28, 37, 45, 


, , 54 

2, 4, 5, 6, 9, 12, 15, 17, 19, 20, 22, 23, 
24, 35, 27, 30, 31, 32, 35, 38, 42, 44, 45, 
50, rere 56, 58 


2,9 

2,9 9, 45, 53, 54 
2,9 
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tions of the B-L composite rating of the 
teaching situation and the M-Blank rating of 
educational methods with the criterion are 
significant at the five per cent level. However, 
as can be determined from Table XLVIII, the 
coefficients of correlation between the crite- 
rion and several of the other measures 
approach significance at the five per cent 
level. These are: the Cooperative English 
Test, the composited rating from two inter- 
views as to general impressions, the prediction 
of teaching efficiency made by staff member 
E based on personal data, the evaluation of 
teaching efficiency made by staff member B 
using the Barr—Harris Teacher’s Performance 
Record, and the composite of five evaluations 
of teaching performance using the M-Blank. 
This latter measure is the criterion treated in 
Section IV.r. 

It is determined, then, that not only is 
there little relationship between the criterion 
of pupil evaluations of teaching efficiency and 
the measures collected concerning each 
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teacher as a student, but also that the rela- 
tionship between the two criteria of teaching 
efficiency, supervisory ratings and pupil 
ratings, is not sufficiently great so that the 
size of the coefficient of correlation between 
them cannot be attributed to chance. 

Worthy of note is the fact that, in general, 
the objective measures treated are very little 
related and/or are negatively related to the 
pupil evaluations, whereas, subjective meas- 
ures are, in general, little related and/or posi- 
tively related to the criterion. This shows a 
consistency even though the coefficients of 
correlation are not large. 

In analyzing the data, the intercorrelations 
of seven of the measures relating to each 
teacher as a student were computed and 
placed in an intercorrelation matrix with the 
criterion (Table XLIX). The matrix was 
solved using Aitkin’s method, previously dis- 
cussed, and the multiple correlations for com- 
binations of factors were computed. The beta 
coefficients are presented in Table L. 


TABLE XLIX 


INTERCORRELATIONS AMONG SEVEN VARIABLES, EMPLOYED IN. PREDICTING TEACHING EFFICIENCY, 
AND THE CRITERION OF PUPIL EVALUATIONS 

x 1 x 2 x 3 x 4 
1. 000 . 289 . 264 . 299 
.289 1.000 . 589 . 597 
. 264 . 589 . 000 . 726 
. 299 . 597 . 726 . 000 . 715 
. 349 . 753 . 718 . 715 1.000 
. 123 . 222 . 055 . 041 . 292 
. 047 . 160 . 058 . 289 


.211 
—. 311 . 245 .343 —.339 . 324 


Xs 
. 349 
. 753 
. 718 


X- 
. 123 
. 222 
. 055 
. 041 
. 292 
. 000 
. 180 


277 


X; 
. 047 
.211 
. 160 
. 058 
. 289 
. 180 
. 000 
. 285 


X , Comp. Sit. 

X. Comp. Hen.-Nels. 

X; Coop. Read. 

X, Gen. Cult. 

X, Eng. Coop. 

X, Pred. from Pers. Data (E 
X ; Gen. Impress. Interview 
X. Criterion 


TABLE L 

BETA COEFFICIENTS FOR THE SEVEN VARIABLES EMPLOYED IN PREDICTING TEACHING EFFICIENCY 
x 1 xX 2 x 3 x 7 x 5 x 6 x 7 
X, Comp. B-L Sit. .-—.311 —.262 —.234 —.222 —.216 —.232 —.215 
X. Comp. Hen-Nels. : .169 —.017 .019 . 048 . 024 .017 
<; Coop. Read. _-_- : ; _..—. 271 -. 189 .171 —.090 —.109 
X, Gen. Cult. edit 7 .131 —.027 . 087 
X; Eng. Coop. —. 28 —. 61 
<; Pred. from Pers. Data (E 391 . 370 
Gen. Impress. Interview . 370 


TABLE LI 

SIGNIFICANCE OF THE COEFFICIENTS OF MULTIPLE CORRELATION FoR SEVEN VARIABLES 
Variables Per Cent 
Involved Sig. Level 
Ro. 1 2.93 
Ro. 12 1.73 
Ro. . 578 
R O 1234 

123465 


- 495 

Ro. . 544 
Ro. le oe 6 
@ Beoe F 


Cri. R 


X , Comp. B-L Sit. 
X , Comp. Hen-Nels. - - 
: Coop. Read... - - 
Cen. Cult... : yee 
ae ewes ; 
Pred, From Pers. Data (E)-_ ------- ee 
X; Gen. Impress. Interview 


123 


. 031 
. 003 
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TABLE LII 


INTERCORRELATIONS AMONG FOUR VARIABLES, EMPLOYED IN PREDICTING TEACHING 
EFFICIENCY, AND THE CRITERION 


X, Comp. B-L Eval. of Sit 

X. Cooperative Reading Test 

X ; Comp. Gen. Impress. (Inter.) - - - - -- -- 
X, Pred. from Pers. Data (E)_-- 

Xs 


5 ee 


nee ne —. 311 


X, X: Xs 
. 264 . 047 
1. 000 . 160 
. 160 1.000 
. 055 . 180 
—. 343 . 285 


TABLE LIII 


Beta COEFFICIENTS, COEFFICIENTS OF MULTIPLE CORRELATION, AND SIGNIFICANCE LEVEL OF THE 
MULTIPLE CORRELATIONS FoR THE MATRIX OF TABLE LII 


Beta Coefficients 
» # Xs; 
—. 239 
—. 337 

. 350 


—. 237 


A coefficient of multiple correlation of .654 
is obtained from the combination of the seven 
factors. This is significantly different than 
zero at the three-thousandths of one per cent 
level. For the coefficients of multiple correla- 
tion and the significance level of these coeffi- 
cients employing seven or less variables, 
reference is made to Table LI. 

The Cooperative General Culture Test and 
the composite of the high school and college 
estimates of mental ability based on the 
Henmon—Nelson Test did not seem to con- 
tribute a great deal to the multiple correlation 
so they were eliminated and a new matrix 
(Table LIT) was set up using the other four 
items, namely, a composite of the evaluation 
of the teaching situation made by two staff 
members of the Department of Education; 
the score on the Cooperative Reading Test; 
a composite of two estimates of the probable 
teaching efficiency of each person based upon 
interviews made by members of the staff of 
the Department of Education; and an esti- 
mate of each teacher’s probable success made 
by staff member E from a study of the steno- 
graphic reports of the interviews, a student 
autobiography, and an activity report made 
by each student upon certain experiences in 
Education 73 and 74. The multiple correla- 
tion was found to be .602. Each factor when 
added to those previous in the matrix con- 
tributes to the coefficient of multiple correla- 
tion. This is shown in Table LIII in which 
the beta coefficients, coefficients of multiple 
correlation, and the significance level are pre- 
sented. 


—.271 
—. 336 
. 302 
. 276 


Per Cent 
Sig. Level 
2.93 
. 527 
. 031 
. 007 


R Variables 
X4 Involved 


.311 R 

.412 Ro. 12 

. 538 Be ses. 
. 602 Ro. 1234 


IV.3. THE CRITERION OF PuPIL GAIN As A 
MEASURE OF TEACHING EFFICIENCY 


The residual pupil gain of 27 classes taught 
by 17 teachers was the third and final criterion 
of teaching efficiency employed in this investi- 
gation. Of the 58 teachers under consideration 
(Appendix E),* teachers 4, 8, 10, 12, 14, 16, 
20, 22, 24, 25, 26, 34, 41, 45, 48, 55, and 57 
participated with their classes being given 
standardized tests either by the principal or 
by the respective teacher under the direction 
of the principal. 

An attempt was made to ascertain whether 
or not information collected during the period 
of institutional education was a valid meas- 
ure of the gain which would be made by the 
students taking work with each teacher after 
she had entered upon teaching responsibili- 
ties, and whether or not accurate predictions 
of the residual gain of the pupils could be 
made. 

From the Pearson-Product-Moment coeffi- 
cients of correlation calculated, using un- 
grouped data, between certain measures rela- 
tive to each teacher as a student and the cri- 
terion (Table LIV), it was found that the best 
single measure of residual pupil gain is the 
rank of the teacher in her high-school gradua- 
tion class (r = .688 + .132). Without ex- 
ception, the coefficients of correlation, which 
are significantly different than zero, are either 
relationships between the criterion and objec- 
tive measures or predictions of probable suc- 
cess as a teacher based upon objective 

* See original thesis on file, Library, University of Wisconsin. 
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TABLE LIV 


ZERO ORDER CORRELATIONS WITH CRITERION OF PUPIL GAIN 


Per Cent Teachers Omitted in 
Measures Er Conf. Limit N Correlation 
H. S. Rank aut j . 132 ‘ 16 
Comp. Hen-Nels. (H. S. & Coll.)_. / . 250 ; None 
Coop. English Test wm . 316 : 8, 16, 22, 24, 26, 41 
Am. Council Ps - gh Exam... -, . 250 4 None 


Coop. General Culture_. . 237 " None 
247 None 


Coop. Reading Test tics ‘ ; ; 
National Teacher’s Exam._ ; . 307 , 4, 10, 12, oy 16, 20, 25, 
Predicted G. P. A ; . 249 ; 
Comp. Fresh-Soph. G. P. A. : . .172 , None 
Comp. Jr.-Sr. G. P. A ; ; . 208 ; None 
Tota Fou- Year G. P. A._____- . . 5 . 180 3. None 
G. P. A. in Major P .174 , None 
First Minor G. P. A. .201 : None 
Education G. P. A. . 183 3. None 
Prac. Teaching, Educ. 75 . 250 : None 
Comp. Prac. Teaching se ; ’ None 
Comp. Educ. 73-74-75 G. P. A.- . 183 " i None 
Total Rat. Assign. Act. (73) . . 271 10, 12, 25, 34 
Comp. Rat. Assign. Act. (73-74) : 2 
Prof. Judgment (Two Interviews) - - : . 240 
Sociability (Two Interviews) _ __ ___- P . 261 
Work Habits (Two Interviews) - _ - mt . 253 
Motivation and Values (Int.)_____- . . 243 
Gen. Impressions (Interviews) ; . 215 
Originality, Creativity, Initiative 

Two Interviews) ; . 260 
Comp. Interview Ratings - - ---- --- . 306 . 234 
As a Person (Educ. 75 Rat.)___- . 071 . 276 
As a Student (Educ. 75 Rat.)__- . 215 . 264 
As a Leader (Educ. 75 Rat.)___- : . 184 . 268 
As an Advisor (Educ. 75 Rat.)- . 042 .277 
Comp. Educ. 75 Rating . 151 . 271 
Comp. B-L Eval. of Situation .217 . 246 
Pred. from Obj. Data (B)__-_- . 444 .215 
Pred. from Pers. Data (E)_ - —. 022 . 250 
Pred. from Obj. Data (E)_ _- .5§11 . 191 
Comp. Prediction (E) ; . 344 . 288 
Pred. of Major Dept.__- . 130 . 254 
Barr-Harris Perf. Record . 305 . 234 
ee M-Blank “ . 193 . 241 
Pupil Eval. of Teaching. . 055 . 266 


TABLE LV 


COMPARISON OF THE ZERO ORDER CORRELATIONS AND THE PARTIAL CORRELATIONS WITH THE 
SITUATION HELD CONSTANT BETWEEN THE CRITERION OF PUPIL 
GAIN AND SELECTED MEASURES 


Zero Order Partial 

Measures Correlations Correlations 
H. S. Rank - . 688 . 739 
Comp. Fresh.-Soph. G. P. A._ = . 558 . 559 
G. P. A. in Major_. ‘stnatanabeas . 552 . 553 
Comp. Rating in Educ. 73-74... ___ pa . 334 . 267 
Gen. Impressions (Interviews)______ ; ocean .411 . 367 
Pred. from Obj. Data (E)- ‘ Sie abbeeden .511 . 526 
Comp. Pred. Obj.-Subj. Data (E) __- , iexases ; . 344 . 327 
Pred. of Major Dept. ‘ : . 130 . 188 
Comp. Prac. Teaching G. .2 es ee - , . 207 . 223 
Comp. Educ. 73-74-75 G. P ; EEE A I ME Ne SATS AE . 519 . 516 
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measures, Only high-school rank is correlated 
sufficiently to be significant at the one per 
cent level or below. However, a number of 
measures are significantly related to the cri- 
terion at less than the five per cent level. 
These are a composite of university freshman- 
sophomore grade point averages, the total 
grade point average for four years of college, 
the grade point average in the major field of 
concentration, grade point average in educa- 
tion courses when all courses are considered 
or when a composite of Education 73, 74, and 
75 is made, and the prediction of probable 
teaching efficiency made by staff member E 
and based upon objective data. 


The lack of relationship between each of 
the two criteria previously discussed and the 
criterion of residual pupil gain indicates that, 
whatever is measured by the criterias, they 
are not measures of the same thing. Of im- 
portance, also, is the lack of relationship be- 
tween grades in practice teaching and the 
criterion of pupil gain. 

Partial correlations were computed between 
the criterion and selected variables with the 
evaluation of the teaching situation held con- 
stant. These are presented in Table LV. In 
general, the correlations are not changed 
greatly by holding the evaluation of the situ- 
ation constant. The partials for high-school 
rank and the prediction of the major depart- 
ment raise the correlation. while for the com- 
posite rating of Education 73 and 74 and the 
rating as to general impressions as the result 
of two interviews, the correlation is lowered. 
This is to be expected since the evaluation of 
the teaching situation is not sufficiently re- 
lated to the criterion not to be attributed to 
chance and other interfering factors. 


In an attempt to analyze the data more 
thoroughly, the beta coefficients for a multiple 
regression of t1 independent variables were 
computed. The intercorrelation matrix of the 
tt variables and the criterion is presented in 
Table LVI while the beta coefficients and the 
coefficients of multiple correlation for combi- 
nations of variables appear in Table LVII. 
Two of the variables apparently detract from 
the multiple correlation. They are a composite 
of the grade point average in Education 73, 
74, and 75 and the composite prediction of 
staff member E based on subjective and ob- 
jective information. 
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Obviously, the multiple correlation obtained 
(.914) is very high and much higher than 
might be expected. However, the standard 
error is also very high since N = 17 and the 
number of independent variables is 11. In 
fact, using the F test of Smith and Duncan,‘ 
the coefficient of multiple correlation with 
either 10 or 11 variables is not significant at 
the five per cent level. It differs from zero at 
the 4.1 per cent level. The decrease in sig- 
nificance is more definitely pointed out in 
Table LVITI. It is observed that the probable 
minimum correlation’ also decreases. 


The regression equation of eleven inde- 
pendent variables, 


2, ==— .7422, + 1.4642, — 2.7582, +- 2.6212, 
— .o80z, + 2.6112, + .0372, — 1.9192, 
— .7032, — .6662,, — .2132,;, 


was employed in predicting the probable suc- 
cess of each teacher in the study. The pre- 
dicted score of each teacher, the residual pupil 
gain (here used as the criterion of success), 
the corresponding letter and z scores, and the 
letter displacement are presented in Table 
LIX. Eight or 47.06 per cent of the letter 
predictions do not depart from the actual suc- 
cess score while 14 or 82.35 per cent depart 
by one letter or less. 

Since several of the factors used in the 
above prediction equation did not seem to add 
to the team of factors and since the coefficient 
of multiple correlation is not significant at the 
five per cent level according to the F test em- 
ployed, it was thought desirab'e to eliminate 
a number of factors. The matrix for the mul- 
tiple correlation to be reported consists of 
only six of the eleven measures previously re- 
ported and is composed of both subjective 
and objective items. These are: X,, high- 
school rank; X,, rating on general impres- 
sions—a composite of two interviews; X,, 
prediction as to probable teaching success 
made by the major department; X,, com- 
posite of the ratings made in the assigned 
activities of Education 73 and 74; X,, com- 
posite of two practice teaching grades; and 
X., the prediction made of probable teaching 
efficiency by staff member E from objective 
data. The beta coefficients resulting from the 
solution of the matrix are presented in Table 
LX together with the coefficients of multiple 
correlation. 


4Smith and Duncan, op. cit. 
5 Ezekiel, op. cit. 
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TABLE LVIII 
SIGNIFICANCE OF THE MULTIPLE CORRELATIONS For ELEVEN VARIABLES 


Variables Per Cent Probable Minimum 
Involved Sig. Level Correlation 
Ro. 1 70.04 4 . 000 
R - 12 . 960 "e = 
Ro. i123 1.077 fo. . 249 

- 1234 1.109 yp 

- 12345 . 648 

. 502 


» Joon © 


1 
Ieee 8 . 
b dene f & 
. 1 10 3. 
.914 1 4. 


* 5°... indicates that the significance level is nearer one per cent than five per cent. A percentage 
with a plus sign indicates that the significance level is greater than the per cent indicated. 


TABLE LIX 
PREDICTED SUCCESS AND ACTUAL SUCCESS IN TERMS OF RESIDUAL PuPIL GAINS 


Predicted Actual Letter 
Predicted Pupil Letter Letter Displace- 
Teacher No. Score Gain Value* Value** ment 
_...—8. 603 —. 600 
‘ . 770 1. 840 
. 027 —.018 
.917 . 057 
. 075 . 192 
. 574 .127 
.141 . 257 
. 096 . 794 
. 469 . 343 
. 564 . 698 
. 309 . 938 
. 135 . 867 
. 528 —. 389 
. 861 —. 100 —, 

-. 611 . 967 —.359 ; 

. 028 1. 702 1. 209 1. 689 

1.059 —1.146 —.625 —1.722 


*The following values were arbitrarily  ——, A =.964—1.738; B =.189—.963; C = —.586—.188; 
D =—1.361— (—.587) ; E = —2.137— (—1.362). 

** A =1.139—1.854; B=.424—1.138; C= —.291—.423; D= —1.006— (—.292); E= —1.722— 
(—1.007). 
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TABLE LX 


BETA COEFFICIENTS For Six VARIABLES EMPLOYED IN THE PREDICTION OF TEACHING 
EFFICIENCY USING THE CRITERION OF PupPIL GAINS* 


X, X: X; X« Xs Xs 
1 H.S. Rank--- ‘ . 688 . 627 . 795 1. 366 1.475 1.358 
“REE Sarees . 192 .512 . 453 : 
s Dept. Pred.___- SE ee OE as ; —. 358 —.618 —. 564 
4 73-74 Rating re ‘ —. 811 —. 705 


Prac. aes. ¥ A Sane aaa . 275 
* Obj , ae NO ee AEA heak- [re 
(. 976) 


X 
xX 
x 
xX 
Xs 
xX 


* Numbers in parentheses are multiple correlations derived through the use of all factors up to that 
point. 
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TABLE LXI 


SIGNIFICANCE OF THE MULTIPLE CORRELATIONS USING Six FACTORS 


Per Cent Probable Minimum 
Sig. Level Correlation 
. 781 . 400 
. 879 
. 438 


.614 
. 673 


Variables 
R Involved 
. 688 
. 700 Ro. 12 
. 761 123 
. 894 - 1234 
.914 - 12346 
. 976 me Hx 8 


. 194 
. 245 
. 200 


Ce 

eye y 
| 

tlt dtd 


Not only are the multiple correlations 
higher, with the same number of factors, when 
the six variables are used than when the 
eleven were considered, but the significance 
level is aiso lower as demonstrated by Table 
LXI. Worthy of note is that a better predic- 
tion is obtained, when the criterion of residual 
pupil gain is used, if the evaluation of the 
teaching situation is omitted. 

If a regression equation is formed with five 
factors, being respectively high-school rank; 
the prediction from objective data by staff 
member E; the composite freshman-sopho- 
more grade point average; the grade point 
average in the major; and the composite of 
Education 73, 74, and 75 grade point aver- 
ages, the coefficient of multiple correlation is 
only .742. This is not sufficiently large not to 
be attributable to chance since the probable 
minimum correlation is .coo and by the F test 
it is not significant at even the five per cent 


level. The four factors of high-school rank, 


grade point average in the major, a composite 
of the grade point averages of Education 73, 
74, and 75, and the prediction from objective 
data made by E yield a coefficient of multiple 
correlation of .736 when combined. This is 
significantly different than zero at the five 
per cent level. When the high-school rank and 
the B-L evaluation of the teaching situation 


are combined, a multiple correlation of .692 
is obtained. This is only slightly higher than 
the zero order coefficient obtained using high- 
school rank alone (r = .688). 


IV.4. SUMMARY AND CONCLUSIONS 


The central purpose of the investigation 
reported in this section has been to determine 
how accurately predictions of teaching effi- 
ciency can be made in terms of data which 
can be collected during institutional prepara- 
tion for teaching. 

Three criteria of teaching efficiency were 
employed, namely, a composite of five super- 
visory ratings, an evaluation of each teacher 
made by the students in her classes, and 
residual pupil gain as measured by standard- 
ized tests. 

On the basis of the study reported, it would 
seem that: 

1. The criteria of teaching efficiency em- 
ployed are not related to greater degree than 
can be attributed to chance. Whatever, then, 
is measured by each of the criteria, it appears 
that they do not measure the same aspects 
of teaching efficiency. 

2. If the criterion of supervisory ratings is 
accepted as a valid measure of teaching effi- 
ciency, more accurate placement of prospec- 


TABLE LXII 


MEANS AND STANDARD DEVIATIONS OF THE MEASURES USED IN PREDICTING TEACHING EFFICIENCY 
WHEN THE RESIDUAL PuptIL GAIN Is USED AS THE CRITERION 


Measures 

H. S. Rank. 

Comp. Fresh.-Soph. G. P. A.- 

G. P. A. in the Major 

Comp. Prac. Teaching (Major-75)_- 
Comp. Educ. 73-74-75 G. P. A. 
Comp. Rat. Activity Educ. 73-74__ 
Comp. B-L Eval. of Situation _ 
Pred. from Obj. Data (E) 

Comp. Pred. Obj.-Subj. Data (E) 
Pred. Major Dept. 

Gen. Impress. (Interview) 
Criterion , 


M 
61. 88 
829 
. 913 
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tive teachers, with the placement personnel 
having a knowledge of the situation into 
which the teacher will go, will lead to more 
effective teaching on the part of the teacher. 


3. The most valid prediction of teaching 
efficiency in terms of supervisory ratings is 
the combination, through multiple regression, 
of the following factors in order as listed: 
(1) B’s prediction of teaching efficiency based 
on objective data, (2) a composite of two 
interview ratings as to general impressions, 
(3) rating in ability in the assigned activity 
of Education 73, (4) prediction of teaching 
efficiency made by the major department in 
which each student specialized, and (5) com- 
posite of B and L’s evaluation of the situation 
in which each teacher was teaching. The co- 
efficient of multiple correlation is .680 which 
assures a probable minimum correlation of 
.448 with five variables being involved. 


4. It is more difficult to predict student 
opinion as a measure of teaching efficiency 
than it is to predict teaching efficiency as 
measured by either pupil gain or supervisory 
ratings. 

5. Teaching efficiency as measured by pupil 
evaluations can most validly be predicted 
using a combination of the B-L evaluation of 
the teaching situation, the scores of each 
teacher as a student on the Cooperative Read- 
ing Test, the composite rating of general im- 
pressions as the result of two interviews, and 
the prediction of teaching success made by 
staff member E and based on personal data 
concerning each teacher as a student (R, 405, 
= .602). 

6. The type of position accepted by a 
teacher does not condition significantly the 
amount of gain which will be made by her 
students. 


7. The best single measure of residual 
pupil gain is the rank in high school of the 
teacher (r == .688). The best estimate through 
combination of factors is that employing the 
following measures: high-school rank, general 
impressions rating on two interviews, the pre- 
diction of teaching efficiency made by the 
major department, the composite rating of 
Education 73 and 74 on the assigned activity, 
the composite of two practice teaching grades, 
and the prediction made from objective data 
by staff member E (R,.,0545, == -976). 
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SECTION V 
SUMMARY AND CONCLUSIONS 


Two prediction studies relative to teachers 
and teaching efficiency have been reported 
herein. The first is a study predicting whether 
or not students expressing teaching as their 
first choice of occupation on the Application 
for Admission, University of Wisconsin, will 
be admitted to the School of Education at 
the beginning of the junior year of univer- 
sity training. The second is a study predict- 
ing the teaching effectiveness of graduates 
of the School of Education, University of 
Wisconsin, in terms of three criteria of 
teaching efficiency (supervisory ratings, pupil 
change, and pupil evaluations of the teacher). 
The former investigation is concerned with 
204 individuals who entered the University in 
1939 after graduation from Wisconsin high 
schools and the latter involves 58 University 
of Wisconsin graduates receiving the Univer- 
sity Teacher’s Certificate in 1943. 


On the basis of the findings previously re- 
ported, certain conclusions and observations 
relative to both studies seem warranted. 
Since one investigation has little immediate 
bearing on the other, they are treated sepa- 
rately. 


V.1. PrepicTion Stupy ONE 


The criterion of composite freshman-soph- 
omore grade point averages appears to be a 
valid measure of whether or not a person will 
be admitted to the School of Education. The 
rectilinear coefficient of correlation with the 
criterion of being admitted or not being ad- 
mitted is .goz2 + .044 for the samp'e of 
women and .817 + .o85 for the sample of 
men. 

It is found that the differences of the means 
between the samples of men and women are 
significant for the measures of combined 
freshman-sophomore grade point average. 
percentile rank in high-school class, percentile 
rank on the Henmon—Nelson Test of Mental 
Ability (high school and college norms), per- 
centile rank on the American Council on Edu- 
cation Cooperative English Test (Usage, 
Spelling, and Vocabulary), American Council 
on Education Psychological Examination For 
College Freshmen, high-school principal’s pre- 
diction of academic success, hours of home 
study during senior year of high school, and 
predicted university grade point average. For 
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all measures, the mean of the sample of men 
is lower than that of women. 

There is indication that the men preparing 
for teaching have a lower grade point average 
at the beginning of the junior year than the 
women. This may result from the fact that 29 
of the 55 men considered were in physical 
education and were thus admitted to the 
School of Education at the beginning of the 
freshman year with the only requirement 
being that they be admitted to the University. 
On the other hand, the women taking major 
fields of specialization were admitted at the 
beginning of the junior year after meeting a 
credit-grade point requirement of 58 credits 
and 73 grade points or 60 credits and 75 
grade points depending upon which pre- 
education sequence was followed. 

The best single measure for predictive pur- 
poses is percentile rank in high-school class. 
The coefficient of correlation for the sample 
of men when the criterion of composite 
freshman-sophomore grade point average is 
used is .528 + .roo and for the sample of 
women is .704 + .044. 

Success in being admitted to the School of 
Education can be predicted more accurately 
for the group of women than the group of 
men. 

The multiple correlations when the crite- 
rion of composite freshman-sophomore grade 
point average is used are slightly higher than 
when the criterion of being admitted or not 
being admitted to the School of Education is 
employed. This may have been the result of 
elimination from the total sample of the grad- 
uates in other fields than teaching when the 
first criterion was employed. 

If the requirement of a 1.25 grade point 
average for admission to the School of Edu- 
cation is maintained, the prediction made 
with the prediction equation for university 
grade point average as employed by the reg- 
istrar’s office, for all practical purposes, is as 
good as the prediction equation derived, with 
the same variables, as the result of this study. 
However. if a higher average is necessary, up 
to 1.50, the prediction equation of this study 
is superior for selective purposes. 


V.2. PrepicTIon Stupy Two 


The three criteria of teaching efficiency (a 
composite of five supervisory ratings, pupil 
gain, and pupil evaluations) are not related to 
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greater degree than can be attributed to 
chance. Whatever, then, is measured by each 
of the criteria, at least it appears evident that 
these criteria do not measure the same aspects 
of teaching efficiency. 

If the criterion of supervisory ratings is 
accepted as a valid measure of teaching effi- 
ciency, more accurate placement of prospec- 
tive teachers, with the placement personnel 
having a knowledge of the situation into 
which the teacher will go, will lead to more 
effective teaching. 

The most valid prediction of teaching effi- 
ciency, derived from this study, in terms of 
supervisory ratings is the combination, 
through multiple regression, of the following 
factors in order as listed: (1) staff member 
B’s prediction of teaching efficiency based on 
objective data, (2) a composite of two inter- 
view ratings as to general impressions, (3) 
rating in ability in the assigned activity of 
Education 73, (4) prediction of teaching effi- 
ciency made by the major department in 
which each student specialized, and (5) com- 
posite of B and L’s evaluation of the situa- 
tion in which each teacher was teaching. The 
coefficient of multiple correlation is .680 
which assures a probable minimum correlation 
of .448 with five variable being involved. 

It is more difficult to predict student 
opinion as a measure of teaching efficiency 
than it is to predict efficiency as measured by 
either pupil gain or supervisory ratings. 

Teaching efficiency as measured by pupil 
evaluations was most validly predicted using 
a combination of the B-L evaluation of the 
teaching situation, the scores of each teacher 
as a student on the Cooperative Reading Test, 
the composite rating of general impressions 
as the result of two interviews, and the pre- 
diction of teaching success made by staff 
member E and based on personal data con- 
cerning each teacher as a student (R,.,.,, = 
.602). 

The type of position accepted by a teacher 
does not condition significantly the amount 
of residual gain which will be made by her 
students. 

The best single measure of residual pupil 
gain is the rank of the teacher in her high 
school graduation class (r == .688). The best 
estimate found through combination of 
factors was that employing the following 
measures: high-school rank, general impres- 
sions rating on two interviews, the prediction 
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of teaching efficiency made by the major de- 
partment, the composite rating of Education 
73 and 74 on the assigned activity, the com- 
posite of two practice teaching grades, and 
the prediction using objective data and made 
by staff member E (R,.40545¢ == -976). This 
is considerably higher than that obtained 
when either pupil evaluations or supervisory 
ratings was employed as the criterion and 
may be attributed, in part, to the fact that a 
larger number of independent variables are 
involved, that the sample is small (17 cases), 
and that a correction was made for the nega- 
tive correlations ordinarily found between ini- 
tial pupil scores and gains. The latter was 
accomplished through multiple regression 
using the criteria of gains and the independ- 
ent variables of pre-test score, mental age, 
and intelligence quotient. 

While the results varied somewhat for the 
different criteria, a number of items seemed 
to have predictive value, particularly: high- 
school rank, predicted grade point average, 
the actual grade point average for different 
subjects and years, grades in practice teach- 
ing (if the criterion of supervisory ratings is 
employed), combined impressions of two in- 
terviews made by members of the staff of the 
Department oi Education, and the various 
predictions of teaching efficiency made 
through the use of objective data concerning 
each teacher as a student. 

As important as discovering measures re- 
lated to teaching efficiency, for the purposes 
of this study, is locating pre-service factors 
which do not appear to have predictive value 
since this represents an area in which changes 
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in pre-service preparation may be warranted. 
It is necessary to consider, in this respect, 
that the criteria used as well as the measures 
concerning each teacher may be rough esti- 
mates because of lack of sufficiently developed 
instruments. In stating, then, that measures 
are not found to be significantly related to 
teaching efficiency, it must be kept in mind 
that this is not necessarily a criticism of the 
teacher education program but rather is an 
area in which thought might be given to the 
development of procedures and measuring in- 
struments which are more valid. 

Grades and ratings as measurements in 
practice teaching as conducted at the Univer- 
sity of Wisconsin do not seem significantly 
related to teaching efficiency when either 
pupil evaluations or pupil gain is used as the 
criterion. Scores on the Henmon—Nelson Test 
of Mental Ability and the American Council 
Psychological Examination do not vary with 
any of the criteria to a greater degree than 
can be attributed to chance. This is also true 
of the composite ratings in the assigned activ- 
ities of Education 73 and 74 and scores on 
the National Teacher’s Examination and the 
American Council on Education Cooperative 
English Test (Usage, Spelling, and Vocabu- 
lary). 

Predictions from subjective and objective 
data seem to be of about equal value except 
when the criterion of pupil gain is employed. 
Here the predictions using objective data are 
higher than when subjective data are used. 
The subjective data held a slight edge over 
objective data in predicting supervisory 
ratings. 
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SECTION I 
THE PROBLEM AND ITS IMPORTANCE 


STATEMENT OF THE PROBLEM 


The purpose of this investigation is to study 
the value of certain types of personal data in 
the prediction of teaching efficiency. The 
study is based upon data from the files of the 
Teacher Personnel Research Committee.** 
The material of a more objective nature such 
as professional tests, tests of mental ability, 
grade-point averages, inventories, and rating 
scales has been considered in other investiga- 
tions of the committee. This study will con- 
cern itself with the materials of a more sub- 
jective nature including general evaluations 
made by the supervisors of school and com- 
munity activities, comments of supervisors of 
practice teaching, interviews, reactions of the 
interviewers, comments of instructors, auto- 
biographies, and a few items of personal in- 
formation taken from the students’ personal 
data booklets. 

More specifically, this study will attempt to 
answer several questions: Do materials such 
as interviews and autobiographies of students 
written during the period of their institutional 
training contain information concerning quali- 
ties that are related to future success in teach- 
ing? Can this information be identified, de- 
fined, and measured? How valid and reliable 
are evaluations of these personal data for the 
prediction of teaching efficiency as measured 
by the three criteria of supervisory ratings, 
pupil evaluations, and residual pupil gain? 

In the analysis of the data, consideration 
will be given to the relative predictive value 
of several personal qualities commonly asso- 
ciated with teaching efficiency. It is hoped 
that the results of the investigation may also 


* The author gratefully acknowledges the assistance rendered 
by Dr. A. S. Barr, Professor of Education, University of 
Wisconsin, and members of the Teacher Personnel Research 
Committee for aid received. 

** The Teacher Personnel Research Committee was formed 
by members of the staff of the School of Education, Univer- 
sity of Wisconsin, in the fall of 1938 and has functioned 
since that time. Its purpose is to study the students seeking 
education for the teaching profession in an effort to improve 
the offerings and guidance services of the School of Education. 


AN EVALUATION OF CERTAIN TYPES OF PERSONAL DATA 
EMPLOYED IN THE PREDICTION OF TEACHING EFFICIENCY 


HerBert I. Von HADEN* 
Racine, Wisconsin 
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throw light upon the effectiveness and practi- 
cality of some subjective data-gathering de- 
vices as instruments of prediction and thus 
make some contribution concerning their 
value for the pre-training guidance; the insti- 
tutional training; the selection and employ- 
ment; the in-service improvement; and the 
retention, promotion, and dismissal of 
teachers. 


IMPORTANCE OF THE PROBLEM 


At the close of the last decade the profes- 
sional literature was replete with references to 
the oversupply of teaching candidates. Elias- 
sen and Anderson,’ Sangren,? and others 
called attention to the fact that the heavy 
enrollments in teacher-training institutions 
during the late twenties and early thirties 
had produced a vast oversupply of certificate 
holders. Lawton* and Kotschnig* reported 
similar conditions in England and throughout 
most of Europe. As late as 1935 Evenden, 
Gamble, and Blue® reported that the number 
of candidates without teaching positions was 
increasing at the rate of fifty thousand annu- 


y. 

As a result of the oversupply, school sys- 
tems were in a position to demand personnel 
of superior capacity, training, and apparent 
potentialities for teaching. Teacher-training 
institutions throughout the country sought 
means of coping with the lack of balance be- 
tween supply and demand. The suggestions 
for meeting the problem were many and 
varied, but behind most of them lay the 
theory that the selection of candidates should 


1R. H. Eliassen and Earl W. Anderson, “Investigations 
of Teacher Supply and Demand,” Educational Research Bulle- 
tin of Ohio State University, Vol. XVIII (April, 1939), pp. 
239-246. 

2P. V. Sangren, ‘Selection of Prospective Teachers,” Amer- 
ican Educational Research Association Bulletin (Washington: 
National Education Association, 1935), pp. 176-180. 

3jJ. A. Lawton, “A Study of Factors Useful in Choosing 
Candidates for the Teaching Profession,” British Journal of 
Educational Psychology, Vol. IX, Part U (June, 1939), pp. 
131-143. 

4Walter M. Kotschnig, “Limiting Student Enrollments,” 
Educational Record, Vol. XVIII (July, 1937), pp. 354-367. 

5 Edward S. Evenden, G Gamble, and Harold G. Blue, 
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the Education of Teachers, Bulletin 1933, Number 10, 11 
(Washington: United States Government Printing Office, 
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be based upon the promise that they possess 
for developing into successful teachers. The 
desirability of pre-training selection of candi- 
dates for the improvement of teacher educa- 
tion is brought out by Crowley:* 


Even if every other phase of an institu- 
tion’s program were superlative, without 
the rigorous selection of candidates efforts 
to improve teacher education would still be 
largely futile. Only students of fine per- 
sonality and real ability should be enrolled 
as candidates for teaching. On this part of 
the program there can be no compromise 
for on this point depends the quality of the 
schools and ultimately the level of Amer- 
ican culture. 


Today the status of teacher supply and de- 
mand has changed completely. One needs only 
to read the daily newspaper or speak to a 
superintendent of schools or a director of a 
placement bureau to assure himself that the 
shortage of teachers is one of the most critical 
problems facing the American schools today. 
Present conditions are in vivid contrast to 
what Evenden referred to as our “startling 


experience to pass in a decade from the ex- 
treme of having schools closed because there 


were no teachers—not even inexperienced 
high-school students with temporary certifi- 
cates—to the other extreme of large surpluses 
of certificated teachers unable to secure any 
kind of educational employment.’” How long 
the present shortage of teaching personnel will 
continue is a matter of varied opinion. It is 
generally agreed, however, that during recent 
years many candidates of inferior quality and 
of a low level of professional training have 
been admitted to the teaching field. No one 
will contend that this procedure has not 
tended to lower the qu-lity of instruction in 
many of our schools. 

As a consequence, it has become imperative 
to attract into teacher-training institutions 
students who possess the qualities and capaci- 
ties for successful teaching. The responsibility 
for recruiting future teachers of high ability 
and outstanding personal qualities rests 
jointly upon the people in the communities, 
upon the public schools, and upon the 
teacher-training institutions. The need for 
having the secondary school take an active 


* Francis M. Crowley, “Selection by Training Agencies,” 
The Phi Delta Kappan, Vol. XXIV (May, 1942), p. 348. 

TE. S. Evenden, National Survey of the Education of 
Teachers, Bulletin No. 10, Vol. VI (Washington: United 
States Office of Education, 1933), p. 192. 
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part in recruiting candidates is emphasized by 
Northway,* Stroh,® Gray,’® and others. How. 
ever quality must not be lost sight of in the 
effort to assure a sufficient supply of teachers 
for the years that lie ahead. It is as true today 
as when Barr" pointed it out a decade ago 
that one of the most effective means for im- 
proving the quality of instruction in the 
schools is to admit to training only those of 
superior potential teaching capacity. 

Although the present undersupply of teach- 
ing candidates may make it appear that pre- 
training selection is not as urgent as it was 
when the supply of certificate holders was 
more abundant, it might be argued that exist- 
ing conditions make it even more necessary 
than formerly for training institutions to exer- 
cise greater care in the selection of their stu- 
dents. Certainly the ultimate welfare of the 
boys and girls who will come under the guid- 
ance and tutelage of the candidate in a future 
teaching position is fundamental and para- 
mount. In many instances candidates for 
teaching positions today are employed with 
less discrimination than when more candidates 
were available for the positions. Practically 
every graduate of the training institutions 
finds his way into the classroom; whereas 
during the years of oversupply those who, for 
one reason or another, were obviously unfitted 
for the teaching profession were unable to 
secure positions. The greater tenure which 
teachers enjoy makes it increasingly less 
likely that inferior teachers will be replaced 
after they have taught a few years. 


Despite the present critical shortage, those 
who are responsible for long-term planning in 
education dare not lose sight of the need for 
the improvement of the quality of instruction 
in the schools and of the personnel to carry 
out that instruction. More valid and reliable 
instruments of selection, then, are essential 
for the protection of boys and girls through 
the general improvement of the level of the 
teaching profession. The responsibility for 
assuring the highest possible quality of in- 
struction rests jointly with the institutions 


’ Ruth M. Northway, “Careful Selection of Candidates for 
Teaching Essential,” The American School Board Journal, Vol. 
LIV (April, 1942), p. 48. 

® Margaret M. Stroh, Vera M. Butler, and Ida M. Jewett, 
Better Selection of Better Teachers (Washington: Delta Kappa 
Gamma ~— National Capital Press, 1943). 

ww. Gray. “Better Selection of Teachers,”” Elementary 
School pm Vol. XLIV (May, 1944), pp. 502-503. 

mA. S. Barr, “The Measurement of Teaching Ability,” 
~—— ¢ ae Research, Vol. XXVIII (April, 1935), 
pp. 569. 
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training candidates, the agencies entrusted 
with the certification of teachers, and the 
administration charged with the selection of 
the personnel. 


SECTION II 
GENERAL DESIGN OF THE STUDY 


The general design of this study, the sub- 
iects studied, the criterion of teaching effi- 
ciency, and the data-gathering devices em- 
ployed in the investigation have already been 
described in the preceding paper, Section II. 


In considering the interviews and autobi- 
ographies, a scale of personal qualities not 
previously described was also devised. A pre- 
liminary list of 43 items was drawn up upon 
the basis of their frequency of mention in 
such studies as that of Emans,'* Charters and 
Waples,’* and other investigators. In confer- 
ence with members of the staff of the School 
of Education, University of Wisconsin, and 
superintendents of schools this list was sub- 
sequently reduced to seventeen and finally 
to eight qualities commonly possessed by suc- 
cessful teachers. The eight qualities were then 
submitted to twenty-five employing officials 
in a like number of Wisconsin school systems. 
They were asked to rate the factors on a five- 
point scale as indispensable, very important, 
important, moderately important, relatively 
unimportant. The rating scale, the letter to 
the employing officials, and the rating scale 
which they employed are included in Appen- 
dix B-10.* 


The variation between ratings of the dif- 
ferent factors was too small to justify elimi- 
nating any of the items from the scale. The 
weighting of the qualities is discussed in the 
next chapter. The five-point scale as finally 
established included: 


1. Adaptability—Ability and willingness to 
make the necessary adjustments to vary- 
ing conditions and situations. Open- 
mindedness. Suggestibility. Flexibility. 


2. Considerateness—Concern for the feel- 
ings and well-being of others. Sympathy. 
Understanding. Cooperation. Unselfish- 
ness. Patience. Helpfulness. 


™ Lester M. Emans, Analysis of Teachin 
Unpublisued Master’s Thesis, University of 
BW. W 


Rating Scales 
isconsin, 1929. 
. Charters and Douglas Waples, The Commonwealth 
Teacher Training Study (Chicago, Illinois: University of Chi- 
cago Press, 19299. 

* See original report on file, Library, University of Wisconsin. 
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3. Energy—Habitual readiness for effective 
action. Force. Vigor. Drive. Vitality. 
Endurance. 

. Initiative—Capacity for taking hold of 
things and assuming leadership. Origi- 
nality. Resourcefulness. Leadership. 

. Professional Judgment—Wisdom in the 
selection of appropriate courses of ac- 
tion, techniques, and materials. Discre- 
tion in dealing with others. Foresight. 
Prudence. 

. Social Adequacy—Ability to attract oth- 
ers and to make easy and enjoyable 
contacts. Adjustment to one’s fellows. 
Cheerfulness, Friendliness. Pleasantness. 

. System of Values—One’s philosophy of 
life, including ethical, social, and eco- 
nomic values. Eagerness to succeed. 
Goals in life. Ambitions, motivations, 
interests. 

. Work Habits — Industriousness, effici- 
ency, perseverance in overcoming difficul- 
ties. Accuracy. Ability to organize. Gen- 
eral evaluation as a prospective teacher. 


These qualities which the administrators 
considered essential were subsequently used 
in estimating the ability of prospective 
teachers from information gathered during 
the period of institutional training. 


SECTION III 
THE ANALYSIS OF THE DATA 


The data which will be analyzed in this 
report include the following: 

1. Comments recorded by two interviewers 
working separately immediately following two 
planned interviews with the subjects, one dur- 
ing the junior year and another during the 
senior year at the University (Appendix A-7) .* 

2. Comments of the students’ instructors in 
the Department of Education concerning the 
candidates’ personal and professional equip- 
ment and their probable future success as 
teachers (Appendix A-8) .* 

3. Similar evaluations made by the super- 
visors of the students’ school and community 
activities and of their work in practice teach- 
ing (Appendix A-11).* 

4. Stenographic reports of two planned 40- 
minute interviews held by members of the 
staff of the Department of Education with 

* See original report on file, Library, University of Wisconsin. 
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the students, one during their junior and the 
other during their senior year at the Univer- 
sity (Appendix A-12).* 

5. Digests of these interviews, in which the 
responses of the subject were classified accord- 
ing to their inferences for eight personal qual- 
ities: adaptability, considerateness, energy, 
initiative, professional judgment, social ade- 
quacy, system of values, and work habits 
(Appendix A-13).* 

6. Educational autobiographies written by 
the subjects as part of the course in Educa- 
tion 73, The Child: His Nature and His 
Needs (Appendix A-15).* 

7. Seven items of personal information 
taken from a Student Data Booklet and a 
Supplementary Student Data Booklet filled 
out during the last two years of institutional 
training (Appendix A-16 and A-17).* 


INTERVIEWER’S COMMENTS ON THE 
INTERVIEWS 


The members of the staff of The Depart- 
ment of Education who interviewed the 
prospective teachers were asked to put down 
their reactions to the candidate immediately 
following each interview. They commented on 


probable professional judgment; sociability; 


work habits; motivation and values; and 
initiative, creativity and originality of the 
interviewee. They also recorded their general 
or first impression of the candidate as a 
prospective teacher. 

In an attempt to arrive at an objective 
evaluation of the comments, the vocabulary 
of the interviewers was carefully analyzed. 
All descriptive terms used under each of the 
six headings were listed and subsequently allo- 
cated on a seven-point distribution ranging 
from the most favorable to the least favor- 
able. The seven steps together with the 
numerical values assigned to each were: very 
superior 5, superior 4, good 3.5, average 3, 
fair 2.5, poor 2, and very poor 1. This analy- 
sis of vocabulary was made by two persons 
working independently. Although the denota- 
tion as well as the connotation of words was 
carefully weighed, the final decision to place 
a descriptive term in one or another of the 
seven step intervals was necessarily made 
upon a somewhat arbitrary basis. 

The procedure might be illustrated by con- 
sidering some of the comments on professional 
judgment, for example. “Superior without a 

* See original report on file, Library, University of Wisconsin. 
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doubt” was rated as very superior; “very 
substantial” as superior; “alert” as good: 
“will probably not move too far or too fast” 
as average; “lacks breadth of viewpoint” as 
fair; “Teachers and pupils will dislike the 
amount of talking’ as poor; and “too indo- 
lent” as very poor. 

Variations in the language habits of the 
interviewers had to be taken into considera- 
tion. One of the staff members, for instance, 
regularly recorded such comments as “prob- 
ably very good”, “probably will mix well”, 
“perhaps fair”, and others. At first it ap- 
peared that these evaluations were somewhat 
less favorable than those of another inter- 
viewer who said more directly, “very good”, 
“will mix well”, or “fair”. More careful study 
of the context and of subsequent statements 
revealed, however, that the first rater merely 
intended to emphasize the predictive nature 
of his ratings by prefacing them with such 
terms as “probably” and “perhaps”, and that 
“probably very good” should be assigned a 
value equal to that given to the “very good” 
recorded by the second rater. 

Even when the most careful effort is put 
forth to analyze the vocabulary of the rater, 
it is difficult to assign a numerical value to 
such general statements as: 

My first impression is that she is reason- 
ably attractive. She reminds me of Mrs. X. 
in manner of expression. Miss D. is a very 
interesting individual, and it is important 
that the next person interviewing her read 
through the brief comments she made be- 
fore going on to the questions themselves. 
I think they are very revealing. It is an 
extremely interesting case because of the 
number of conflicts which she represents. I 
think she probably has possibilities for 
being a very good teacher. Also I doubt 
that students could ever respond to her 
with the warmth and naturalness which 
they might associate with a person who has 
not had such a hard personal struggle. 


Equally perplexing is this comment on 
sociability: 

Miss J. speaks very quietly, but has a 
very pleasant smile and a real twinkle in 
her eye. This proves to be a very effective 
cover-up when she doesn’t know what to 
say or how to handle a particular situation. 
I would think that she might get along 
fairly well with others—if they knew she 
was around. 





September, 1946| 


TYPES OF PERSONAL DATA EMPLOYED 


65 


TABLE I 


ZERO-ORDER COEFFICIENTS OF CORRELATION, STANDARD ERRORS, AND SIGNIFICANCE LEVELS For 
EVALUATIONS OF THE INTERVIEWERS’ COMMENTS WITH VOCABULARY 


ANALYSIS AND THE 
Supervisory 


. Professional Judgment 

. Sociability-- 

. Work Habits. 

. Motivation and Values 

. Originality and Creativity 
General First Impression - _ ___- 


Mean of Qualities 1-5___- 


. 124 
. 133 
-113 
. 122 
-112 
. 131 
.121 


THREE CRITERIA* 
Pupil 

Evaluation 

r Er 
. 142 
. 144 
. 149 
. 148 
. 144 
. 145 


. 143 


Residual 
Pupil Gain 
r E 


r 


. 241 
. 282 
. 231 
. 216 
. 250 


. 192 
(45) 
. 271 
(28) 
. 322 
(22) 
. 369 
(14) 
. 022 
(94) 
. 380 
(13) 
. 280 


(45) (27) 


*The numbers in parentheses indicate the levels of significance expressed in per cents. 


Although the comments on the whole show 
considerable consistency, several examples of 
disagreement in regard to rather specific quai- 
ities illustrate that different interviewers were 
impressed differently. Of case 27, rater 4 says, 
“Not a very good conversationalist ;”’ whereas 
rater 6 observes, “Excellent conversationalist.” 
One rater says of teacher 30, “Strong; dis- 
ciplinarian type of teacher. Good mind, good 
record, practical . . .” The comment of an- 
other rater is, “Rather immature, somewhat 
wishy-washy person who will probably not 
have much effect upon her students or those 
with whom she is associated.” 

These sharp differences occur only in very 
rare instances. They do, however, bring out 
the point that the interviewees reacted differ- 
ently to different personalities at different 
times, or that varied standards existed in the 
minds of the judges. Variations occur even in 
a quality such as ability to converse, which 
can be observed and evaluated more readily 
in an interview than many other qualities. 
The fact that the interviewers used different 
questions from two parts of the interview 
booklet made it appear that reliability coeffi- 
cients would possess little value. 

The numerical value assigned to each of 
the qualities was based on the mean value of 
the two sets of comments submitted by the 
staff members who did the interviewing. The 
zero-order coefficients of correlation,’* their 

“The formula used in calculating the zero-order coefficients 


of correlation was: 
2X,X, —X,2X, 





r= 
v (2X, — X,2X,) (2X2 — X,2X,) 





standard errors,’* and the per cent of the sig- 
nificance levels'* for the coefficients are shown 
in Table I. These and the other correlations 
of the study are not based on the same num- 
ber of cases. The number of cases included 
and the specific cases omitted in calculating 
the coefficients of correlation are given in 
Table Cr of Appendix C.* 

When the quantitative values (Appendix 
C, Table C2)* arrived at through the analy- 
sis of the vocabulary of the interviewers are 
correlated with the criterion of supervisory 
ratings, only those for work habits, .418 + 
.113, and for originality and creativity, .411 
+ .112, are significantly different from zero 
at the one per cent level. The composite of 
five qualities correlate with the same criterion 
with a significance different from zero at the 
two per cent level. None of the qualities, the 
general first. impression, or the composite 
yield coefficients significant at the 10 per cent 
level when pupil evaluation or residual pupil 
gain is employed as the criterion. For five of 
the seven factors the correlations with super- 
visory gain are more significant than those 
with pupil evaluation or pupil gain; in the 
other instances the employment of the pupil 

% The standard errors for these coefficients and those in the 
following tables were computed by use of the formula: 

2 =e 
vN—1 
% The formula used for determining the significance level 


was: 
Significance Level = 1 2 (Area under the normal frequency 
r 


curve at the point of 
N—1 


* See original report on file, Library, University of Wisconsin. 
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TABLE II 


COEFFICIENTS OF CORRELATION, 


THEIR STANDARD ERRORS, AND SIGNIFICANCE LEVELS FoR Two 


INDEPENDENT EVALUATIONS OF THE COMMENTS ON THE INTERVIEWS 
WITH VOCABULARY ANALYSIS 


. Professional eee 

. Sociability_ 

. Work Habits. - 

. Motivation and Values_. 

. Originality and Creativity _- 

. General First Impression _ _ - 
Mean of 1-5 kanal 


* Expressed as per cents. 


gain criterion yields the most significant 
coefficients. 

When the two sets of evaluations made by 
two raters upon the basis of their independent 
analyses of the interviewers’ vocabulary were 
compared, the coefficients of objectivity 
shown in Table II were obtained. All the co- 
efficients are significantly different from zero 
at the one-thousandth of one per cent level, 
the most significant being that for the corre- 
lation between the composites of five qualities 
as evaluated by the two analyses. 

After an interval of eight weeks one of the 
raters again evaluated the comments made by 
the interviewers. This time, however, the 
vocabulary analysis was not used. After the 
comments of the interviewers on a particular 
quality had been read, a numerical value was 
assigned to the quality (Appendix C, Table 
C3).* The mean for the five qualities was 
again computed. Although the rater did not 
analyze the vocabulary systematically as on 
the previous occasion, he had undoubtedly 
benefited from the earlier experience to the 
extent that he was sensitive to the significance 
of careful evaluation of descriptive terms. 
Table III shows the relationship between 
these ratings and the three criteria. 

As was the case when the vocabulary was 
analyzed, the correlations between the evalu- 
ations and supervisory ratings are more sig- 
nificant than those of the evaluations with the 
other criteria. The coefficients of correlation 
of professional judgment, work habits, and 
originality and creativity with supervisory 
ratings are significantly different from zero at 
the one per cent level. The correlation be- 
tween the mean of the five qualities and 
supervisory ratings, .341 + .118, is significant 
at the two per cent level. Again none of the 
evaluations, with the exception of general 

* See original report on file, Library, University of Wisconsin. 


first impression and residual pupil gain, cor- 
relate with the other two criteria to a greater 
degree than might be attributed to chance at 
the 10 per cent level. In each instance the 
level of significance is higher when the factors 
are correlated with supervisory ratings than 
when the other two criteria are used; in six 
of the seven instances the coefficients obtained 
through the use of the pupil gain criterion are 
more significant, although at a low level, than 
those secured when pupil evaluation is em- 
ployed as the criterion. 


The influence of the difficulty of the situa- 
tion was taken into account through the use 
of the formula for partial correlation:** 


The coefficients of correlation, the standard 
errors, and the significance levels for the eval- 
uations of the difficulty of the situation are 
—.331 + .118 (2) with supervisory ratings, 
—.310 + .129 (4) with pupil evaluation, and 
—.237 + .236 (35) with pupil gain. The neg- 
ative correlations might well be expected 
since, as will be recalled, the higher ratings 
were given to the more difficult situations. As 
a consequence, the negative correlations re- 
flect the tendency for raters to evaluate lower 
the effectiveness of those teachers who worked 
in the more difficult situations, and higher the 
success of those who worked under less diffi- 
cult conditions. With the mean of the evalua- 
tions of the five qualities as the first variable; 
the criteria of supervisory ratings, pupil eval- 
uation, and residual pupil gain used succes- 
sively as the second; and the difficulty of the 
situation as the third, the coefficients of par- 
tial correlation, the standard errors, and the 


E. F. Lindquist, Statistical Analysis in Educational Re- 
search (New York: Houghton Mifflin Company, 1940), p. 249. 
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TABLE III 


ZeRO-ORDER COEFFICIENTS OF CORRELATION, STANDARD ERRORS, AND SIGNIFICANCE LEVELS For 
EVALUATIONS OF THE INTERVIEWERS’ COMMENTS WITHOUT VOCABULARY 
ANALYSIS AND THE CRITERIA* 


Supervisory 


tings 
. Professional Judgment 
Se dint os nicgtiich aninn ie oom 
. Work Habits 
. Motivation and Values 
. Originality and Creativity -___- 
General First Impression _ _ __-_- 


Mean of Qualities 1-5 


-117 


.118 


Residual 
Pupil Gain 
r Er 


Pupil 
Evaluation 
ir 


. 140 
. 144 
. 147 
. 142 
. 144 
. 144 
. 142 


. 213 
. 236 
. 223 
. 223 
. 244 


. 383 
(13) 
. 236 
(35) 
. 326 
(20) 
. 331 


(35) 


* Numbers in parentheses indicate significance levels expressed as per cents. 


significance levels of the coefficients with the 
difficulty of the situation held constant were: 


-}- 


Tiog == -408 + .111 (1) with supervisory 
ratings, 
li2.3 -_ .184 
uation, 


Tso.3 == .398 + .217 (13) with pupil gain. 


f= 


.139 (21) with pupil eval- 


The zero-order coefficients were .341 + .118, 
135 + .142, and .354 + .219 respectively. 

A comparison of Table I with Table II re- 
veals unusual consistency in the coefficients 
and supports the contention that either the 
comments possessed a high degree of objec- 
tivity, or that the rater was strongly influ- 
enced by his previous experience in analyzing 
the vocabulary. 


In an effort to secure information concern- 
ing the relative value of a general evaluation 
and of more detailed consideration of qual- 
ities, a third rater was asked to make evalua- 
tions of the interviewees. After the nature of 
the data was explained (Appendix C-1),* he 
was given the following instructions: 


Read the sets of comments for a prospec- 
tive teacher. Then without special study or 
the use of mathematical averages, check on 
one of the enclosed scales your estimate of 
the probable future teaching success of the 
student. You will make only one estimate 
for each student even though there may be 
three sets of comments for that student. 

* See original report on file, Library, University of Wisconsin 


The coefficients of correlation between these 
general predictions and supervisory ratings, 
pupil evaluation, and pupil gain respectively 
were: .188 + .129, —.061 + .144, and .034 
+ .250. 

The data in Table IV and the previous ones 
would support the observation that evalua- 
tions of the comments of the interviewers 
made after careful reading are at least as 
closely related to teaching success, as meas- 
ured by the three criteria, as those based upon 
the more detailed vocabulary-analysis tech- 
nique. The general evaluation made after one 
reading of the comments produced results in- 
ferior to those of either of the other two 
methods. The ratings of all three approaches 
to the study of the interviewers’ comments 
correlate more significantly with the super- 
visory ratings than with the other two cri- 
teria, but even the coefficients obtained 
through the use of this criterion possess lim- 
ited predictive value. They do, however, indi- 
cate that more careful evaluations of such 
comments are worthy of further study. 

To consider the relationship between the 
evaluations with the analysis of vocabulary 
and those without such analysis, coefficients 
of correlation were computed for the mean 
ratings of the five qualities arrived at by each 
method and for the ratings for the general 
first impression obtained in each manner. The 
coefficient of correlation between the mean of 
the five qualities when the vocabulary was 
analyzed and the same qualities when the 
vocabulary was not analyzed was .g15 + .022, 
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TABLE IV 


ZeRO-ORDER COEFFICIENTS OF CORRELATION, STANDARD ERRORS, AND SIGNIFICANCE LEVELS For 
EVALUATIONS OF THE INTERVIEWERS’ COMMENTS BY THREE METHODS 
AND THE THREE CRITERIA* 


“Ratings” 
r 


.121 - 110 . 143 . 280 


Mean of 5 Qualities with Vocabu- 
lary Analysis 


Mean of 5 Qualities without Vo- 
cabulary Analysis 


General Evaluation—No ee 


Pupil Residual 
Evaluation Pupil Gain 
r Er r Er 


(45) (27) 


- 118 . 135 . 142 . 354 


(35) (16) 


. 129 —.061 .144 . 034 


(16) 


(68) (90) 


* Numbers in parentheses indicate significance levels expressed as per cents. 


which is significantly different from zero at 
the one-thousandth of one per cent level. The 
coefficient obtained from the correlation of 
the general first impression with analysis of 
vocabulary and the same item without such 
analysis was .670 + .074, with a significance 
level of one-thousandth of one per cent. 

The relationship between the mean of five 
qualities and the general first impression was 
also examined. The ratings of the two items 
with vocabulary analysis yielded a coefficient 
of correlation of .404 + .113, significant from 
zero at the one per cent level. The coefficient 
for the same items without the analysis of the 
language habits was .706 + .068, which is 
significant at the one-thousandth of one per 
cent level. 


These correlations seem to indicate that 
there is a high degree of relationship between 
the two approaches to the evaluation of sub- 
jective comments, that with careful study of 
language habits and that without. There is 
also indication of considerable agreement be- 
tween what the interviewers recorded as their 
first general impression and the mean of their 
observations concerning the five qualities. 


GENERAL COMMENTS OF INSTRUCTORS 


General comments of the instructors in 
Education 73, 74, and 75 concerning the per- 
sonal qualities and probable potentialities for 
teaching (Appendix A-8)* were available for 
only 35 of the 58 cases. From one to three 
comments on each individual were included 
in the students’ folders. Two comments, the 
first on case 9 and the second on case 51, will 
illustrate the extremes: 

* See original report on file, Library, University of Wisconsin. 


Really one of my outstanding students. 
Has more than her share of personality. 
Displayed considerable initiative and 
originality in planning and executing term 
projects. Accepted responsibility and extra 
class assignments readily. Displayed dis- 
cussion leadership ability. Friendly dispo- 
sition; well liked by the other members of 
the class. Good work habits. Real profes- 
sional motivation. 


And the other: 


A small, reasonably attractive young 
lady who does “B” work without particular 
effort. The kind of person who seemingly 
turns her nose up at everything. While she 
can be very pleasant, I think she might be 
very disagreeable at times. She is a music 
major and I, therefore, may not understand 
her. She appears to be very much of 
formalist who is greatly interested in music, 
but not at all in children. I would question 
her professional judgment, and I think 
there is some possibility that she might 
have considerable difficulty with students 
and even with staff members in a school 
situation, although I was not able to see 
her at work with students. She is the kind 
of person who I would feel ought to be ob- 
served very carefully with the thought that 
possibly she should be prevented from 
entering the classroom because of her lack 
of understanding of boys and girls. 


A composite evaluation of the comments of 
the several instructors was made on the 
seven-point scale used previously to evaluate 
the comments on the interview: very superior 
5, Superior 4, good 3.5, average 3, fair 2.5, 





-—- Ss ei << fo 


eS 


September, 1946] 


r 2, and very poor 1. The vocabulary 
analysis made for the comments on the inter- 
views was followed as clesely as possible. 
Here, however, because the instructors did 
not adhere to a definite list of qualities as 
the interviewers did, it was possible only to 
make a general estimate of the student as a 
prospective teacher. It is recalled that the 
interviewers commented on five qualities in- 
cluding professional judgment, sociability, 
work habits, motivation and values, and orig- 
inality and creativity. 


The evaluations of the instructors’ com- 
ments (Appendix C, Table C4)* when corre- 
lated with the three criteria yield coefficients 
of .239 & .162 (17) with supervisory ratings, 
—.144 + .144 (44) with pupil evaluation. 
and .573 + .238 (11) with residual pupil 
gain. Although it is interesting to note that 
this is one of the few instances in the study 
in which a variable correlates more signifi- 
cantly with the pupil evaluation criterion than 
with that of supervisory ratings, the smaller 
number of cases involved keeps the signifi- 
cance of the coefficient at a low level of 11 
per cent. 


COMMENTS OF SUPERVISORS OF STUDENTS’ 
ScHOOL AND COMMUNITY ACTIVITIES 
AND OF PARTICIPATION AND 
PRACTICE TEACHING 


In connection with her work in Education 
73 and 74, each student engaged in one or 
more school or community activities under 
the supervision of the person entrusted with 
the responsibility for the activity. Most of 
these were group programs and included such 
activities as Girl Reserves, noon recreation at 
schools, reading program, library, church 
recreation, knitting and sewing, guidance, 
dramatics, Sunday school, band, orchestra, 
art club, clay modeling, bowling, Y. W. C. A., 
library, and nursery school. In addition, each 
student carried on participation, or practice 
teaching, work as part of her course in Edu- 
cation 75 and in the methods course in her 
major field. 


The supervisors in charge of the school or 
community activities with which the students 
assisted as well as the regular teachers in the 
classes in which the participation was carried 
on submitted rating sheets for each student 
(Appendix A-9, A-10).* The objective ratings 


* See original report on file, Library, University of Wisconsin 
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of the activity supervisors covering the stu- 
dent’s attitude toward the activity and her 
ability in the activity and those of the critic 
teachers evaluating the student as a person, 
as a student, as a group leader, and as an 
adviser of individuals are included in another 
study of the Teacher Personnel Research 
Committee. The rating sheets also contained 
“general comments” about the student’s work, 
her professional equipment, her personal 
qualities, and her probable success as a 
teacher. The nature of the comments might 
best be illustrated by several examples: 

A participation supervisor writes about 
case 49: 

A very intelligent and ambitious person. 
Will make an excellent teacher. A wealth 
of experience behind her giving broad 
understanding. Very enthusiastic. Very 


quick to learn, cooperate, offer her services. 


Of the same girl a Girl Reserve secretary 
comments: 

This girl is “tops”. Wish I had twenty 
more like her. She is alert to everyday con- 
ditions and problems and brings discussion 
of them to her club girls. She is fun-loving 
and her girls enjoy that. She knows how to 
get results from a club group. She has 
turned one of our most difficult groups of 
girls into a really fine, cooperative club. My 
only suggestions for betterment for her 
would be that she should be more aware of 
her co-advisers. She thinks faster on her 
feet than most people do, and she has an 
excellent vision of things. Because of her 
fast and far-reaching reactions, I feel that 
she should be the sole leader of a club 


group. 
Of case 42, the participation supervisor 
comments briefly: 
Miss X. has a defeatist attitude. She was 
constantly complaining of being over- 
worked. 


From one to four comments of different 
supervisors were available for 55 of the 58 
cases. A composite evaluation of the several 
comments was made in the same manner as 
that employed in translating the instructors’ 
comments to numerical values. Again the gen- 
eral nature of the comments did not allow for 
singling out any particular qualities. The 
coefficients when the ratings of these general 
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TABLE V 


WEIGHTING OF EIGHT PERSONAL QUALITIES, MEANS, STANDARD DEVIATIONS, AND STANDARD 
ERRORS OF THE MEANS ACCORDING TO THE FREQUENCIES OF ASSIGNMENTS 
BY TWENTY-FIVE EMPLOYING AGENTS 


Im- 
portant 


Very Im- 
portant 


Indis- 
Qualities pensable 


portant 


11 
1 


11 


10 
9 
9 


Initiative _ 
Professional 
Judgment 
Social 
Adequacy 
System of 
Values_- 
Work 
Habits___ 


8 
10 
5 


~_ oo CO OF CO-A1 


- 
a“ 


8 
70 


35 21.5 


evaluations (Appendix C, Table C4)* were 
correlated with the criteria were .298 + .125 
with supervisory ratings, .198 + .142 with 
pupil evaluation, and .151 + .252 with resid- 
ual pupil gain. These are significantly differ- 
ent from zero at the four, 18, and 56 per cent 
levels respectively. 


THE INTERVIEWS 


It will be recalled from an earlier report 
that stenographic reports were made of two 
40-minute interviews between the subjects 
and two members of the staff of the Depart- 
ment of Education. Mention was also made 
in the previous chapter of the scale of per- 
sonal qualities (Appendix B-11)* used in 
evaluating the interviews, the digests of the 
interviews, and the autobiographies. The 
raters were asked to record their judgments 
concerning the degree to which the teaching 
candidate possessed each of the qualities of 
adaptability, considerateness, energy, initia- 
tive, professional judgment, social adequacy, 
system of values, and work habits. 


Before a composite of the judgments could 
be made, it was necessary to consider the rela- 
tive significance of each of the qualities for 
success in teaching. To do this a letter and a 
scale (Appendix B-10) ,* discussed previously, 
were sent to 25 superintendents, assistant 
superintendents, and supervising principals in 
Wisconsin school systems asking them to 
assign a weighting of relative significance to 

* See original report on file. Library, University of Wisconsin. 


Moderately Relative'y 


Mean 
Weight- 
ing 
. 28 
28 
96 
00 
16 
84 
. 04 


36 


12 


Unim- S. D. 


portant 


Im- 


. 776 
. 723 
. 871 
. 800 
. 880 
. 833 
. 076 


. 742 
. 897 


1 


151 
. 064 


7 

3.5 
each of the eight qualities commonly associ- 
ated with teaching success. Table V shows the 
weightings assigned to the qualities by the 
25 employing agents. 

Nineteen of the administrators added a 
comment to their ratings. Of these 15 pointed 
out that the qualities were all very vital to 
success in teaching, six referred to the fact 
that the importance of every one made it 
difficult to evaluate them relatively, and three 
indicated that the usual credentials and infor- 
mation available for teaching candidates shed 
little light upon these personal qualities. 


The frequencies of the “moderately impor- 
tant” column were added to those of the 
“important” column to eliminate the very 
small frequencies. With the use of the 
formula:"* 


x? = y(h—hy" 


fi 


a chi square of 12.69 was obtained for the 
table, which for the 14 degrees of freedom 
indicates a probability of more than 50 per 
cent that a chi square equal to or larger 
than the obtained one might be expected on 
the basis of chance. 


When the analysis of variance was applied 
to the ratings of the employing agents (Ap- 
pendix C, Table Cs5),* the within qualities 
variance was found to be 142.48 and that 


"E. F. Lindquist, op. cit., p. 31. 
* See original report on file, Library, University of Wisconsin. 





September, 1946] 


TYPES OF PERSONAL DATA EMPLOYED 71 


TABLE VI 


ZeRO-ORDER COEFFICIENTS OF CORRELATION, THEIR ERRORS, AND SIGNIFICANCE LEVELS For EIGHT 
QUALITIES AND THE COMPOSITE FOR THE INTERVIEW RATINGS AND THE 
CRITERION OF SUPERVISORY RATINGS* 


Rater 1 

Qualities r E; r 

Adaptability- . 3802 ( 2) .120 
Considerate- 

.067 (62) . 132 


. 304 ( 3) .120 
.378 (1) .114 


. 287 ( 4) .122 
. 369 (1) .114 .141 


58 . 304 ( 3) .120 . 224 
58 . 367 (1) .115 


.451 (1) .105 


. 332 


Mean of 8 
Qualities 58 


Rater 2 
E. 


. 228 (10) . 
. 182 (32) 
. 282 ( 4) 
( 2) 
. 218 (11) 
(28) 


(10) 
. 218 (11) 


.899 (1) .111 


Rater 3 
r 


.183 (31) . 
.242 (10) . 
.862 ( 1) .116 
.475 (1). 
. 2382 (10) .125 
.109 (41) .181 


. 187 (16) .128 
.843 (1) .117 


.288 ( 3) .121 


Composite of 
3 sree 

r E, 

( 2) .120 

(22) .129 

(1) .111 

. 098 


.115 


. 301 
. 164 
- 407 
. 513 ( 1) 
. 865 ( 1) 
. 823 ( 2) .119 


. 334 ( 2) .118 
.419 (1). 


-436 (1) .107 


126 
. 130 
. 122 
-118 
- 126 
. 130 


. 126 
. 126 


* Numbers in parentheses indicate significance levels expressed as per cents. 


among the qualities 5.875. The formula*® 
employed was: 
b m ine 7 m 
>_> _ (Xs XY= > _ > 
3=%3 EF | - - 


§j=1 s=3 


(Xi; —X;)? + m > (X,; —X)?, 
523 


where j and & represent the qualities and m 
the number of school administrators making 
the evaluations. 

The degrees of freedom, seven for the 
among traits and 192 for the within traits, 
were then substituted in the formula:*° 


m%,(X, —X)?/(k —1) 
S52,(Xi; — X;)?/k(m — 1) 


The ratio of the among traits to the within 
traits variance is 1.13. F-values of 3.25 and 
5.70 are necessary to assure significance at 
the five per cent and one per cent levels 
respectively, even when the Table for F** is 
read for seven degrees of freedom for the 
smaller variance and 200 for the larger. The 
difference in the mean weightings of the 
judges, on the various qualities, then, is not 
greater than can reasonably be attributed to 
chance. As a consequence it did not appear 
necessary to assign weightings to the different 


qualities. 

* Paul R. Rider, An Introduction to Modern Statistical 
— (New York: John Wiley and Sons, Inc., 1939), 
D. : 

» Ibid., fF 133. 
1 E. F. Lindquist, op. cit., pp. 62-65. 
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Copies of the interviews (Appendix A-12)* 
were given to three judges who had had con- 
siderable experience in the employment and 
supervision of teachers. They were provided 
with the five-point scale of qualities (Appen- 
dix B-11)* and a sheet of instructions (Ap- 
pendix C-2)* which said among other things: 

. . . You are asked to give your impres- 
sion of the degree to which the candidate 
possesses each of these qualities as you 
would estimate it upon the basis of the 
material in the interviews and your experi- 
ence with teachers. 


The ratings assigned to the eight qualities 
for 58 teachers by the three judges and the 
composite of the three ratings are included in 
Tables C6—-Co of Appendix C.* The com- 
posite is the mean of the three ratings. 

Table VI shows the zero-order coefficients 
of correlation, the standard errors, and the 
significance levels for the ratings of the three 
judges and the composite of the three when 
correlated with the criterion of supervisory 
ratings. Of the 36 coefficients, 13 are signifi- 
cant at the one per cent level and ro others 
at less than five per cent level. The high sig- 
nificance levels of the coefficients for all 
ratings on initiative stand out in contrast to 
the low levels for those on considerateness. 
The mean of the ratings for the eight qualities 
for each judge and the three taken in com- 
posite all correlate significantly with the cri- 
terion at less than the three per cent level. 
When the judgment of the three are taken in 

* See original report on file, Library, University of Wisconsin. 
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composite, the same is true for all of the items 
with the exception of considerateness. 

When the difficulty of the situation is held 
constant, the coefficient of partial correlation 
for the composite of the mean judgments on 
the eight qualities with the criterion of super- 
visory ratings is .520 + .098, which is sig- 
nificantly different from zero at the one-tenth 
of one per cent level. The zero-order coeffi- 
cient for the composite and this criterion is 
436 + .107. 

The same ratings when correlated with the 
criterion of pupil evaluation (Table VII) 
yield coefficients of much lower significance, 
five of them being negative. Only one, the 


[Vol. 15, No.1 


mean of the judgments of rater 2, is signifi- 
cant at less than the ro per cent level. Obvi- 
ously the impressions the raters received from 
the interviews are quite different from those 
acquired by the pupils who evaluated their 
teachers. 

When the difficulty of the situation is taken 
into account, the zero-order coefficient of 
.162 + .139 for the composite of the mean 
rating is increased to .221 + .137, with a sig- 
nificance level of 13 per cent. 

Similar are the coefficients between the 
ratings for the interviews and the third cri- 
terion of residual pupil gain (Table VIII). 
Of the 36 coefficients, 13 are negative. Only 


TABLE VII 


ZERO-ORDER COEFFICIENTS OF CORRELATION, THEIR ERRORS, AND SIGNIFICANCE LEVELS FoR THE 
QUALITIES AND THE COMPOSITE FOR THE INTERVIEW RATINGS AND THE 
CRITERION OF PUPIL EVALUATION* 


Rater 1 
Qualities r E r 
Adaptability - .087 (55) . . 134 
Considerate- 
ness____ —.169 (24) . . 201 
Energy _ _ - .231 (11). . 076 
(33) . 
Professional 
Judgment__ 
Social 
Adequacy - - 
System of 
Values_____ 
Work Habits . 142 
Mean of 8 
Qualities... 50 .062 (67) .142 


.125 (39 .217 
(69) . 


. 142 


50 

50 

.. 8&0 
Initiative._.. 50 .141 

50 

50 


. 057 


—.046 (75) 


.080 (58) . 221 


Rater 2 
(35) 
(16) 
(60) 
. 169 (24) 
(13) . 
.209 (15) 


.165 (25) 
(13) 


. 239 (10) 


Composite of 

Rater 3 3 Raters 
E. r E r E, 
. 140 .111 (44) . .206 (15) .137 


.137 .086 (55) . .075 (61) .142 
. 142 .015 (92) . .120 (41) .141 
. 139 100 (49) . .178 (22) .138 
136 .103 (48) . 
. 137 .007 (97) .14: , (35) .140 


. 139 
. 136 


. 135 


.087 (55) . 142 


(89) . ‘ . 142 
(61) . : . 139 


—.021 
. 074 


.070 (63) .142 ‘ . 139 


* Numbers in parentheses indicate significance levels expressed as per cents. 


TABLE VIII 


ZERO-ORDER COEFFICIENTS OF CORRELATION, THEIR ERRORS, AND SIGNIFICANCE LEVELS FoR THE 
QUALITIES AND THE COMPOSITE FOR THE INTERVIEW RATINGS AND THE 
CRITERION OF PUPIL GAIN* 
Composite of 
} Rater 1 Rater 2 Rater 3 3 Raters 
Qualities r E- r E. r E. r E- 
Adaptability - . 224 (38) . 237 .109 (67) .247 .170 (50) .243 .220 (38) .238 
ness _ . 
Energy —.175 (49) .242 .385 (13) .2138 —.002 (99) .250 .124 (63) . 246 
.106 (68) .245 .064 (80) .249 —.052 (84). —.096 (71) .248 
Professiona' 
Judgment - - 
Adequacy.. 17 -.150 (55) .244 . 287 (26) .229 .121 (63) . .000(100) . 
System of 
17 .335 (19) .224 —.051 (84) .249 .070 (78) .249 . 122 (63) . 
Mean of 8 
Qualities... 17 . 182 (47) .242 —.046 (86) .249 .144 (57) .245 .118 (64) . 


Considerate- 
. 289 (26) .229 -.318 (21) .225 . 224 (38) .237 .081 (75) .248 
Initiative. __- 
.216 (39) .238 (45) .241 .429 (9). .195 (44) . 
Socia 
Work Habits 17 .495 ( 5) .189 —! 335 (19) . 222 .271 (28) . 232 .195 (44) . 
* Numbers in parentheses indicate significance levels expressed as per cents. 
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in the case of rater 1’s judgment of work 
habits and rater 3’s evaluation of professional 
judgment do the coefficients reach the 10 per 
cent level of significance. Both are positively 
related to the criterion. 

The coefficient of partial correlation for the 
composite of the mean ratings, when the diffi- 
culty of the teaching situation is held con- 
stant, is .160 + .252, which is significantly 
different from zero at less than the 50 per 
cent level. The zero-order coefficient for that 
variable and the criterion of pupil gain is 
118 + .247. 

The data indicate that the ratings of all 
three judges and of the composite of the three 
on the materials of the interviews are more 
closely related to teaching success when 
measured by supervisory ratings than when 
gauged by either of the other two criteria, 
pupil evaluation and pupil gain. A similar 
relationship appears to exist between the 
judgments on all of the eight qualities con- 
sidered and the criteria. 


THE INTERVIEW DIGESTS 


In an effort to shed light on the way in 
which information such as that contained in 
reports of interviews might be used more 
effectively in the prediction of teaching effi- 
ciency, digests of the interviews (Appendix 
A-13)* with the 58 students were made. In 
doing this, the statements of the interviewees 
from both interviews were classified accord- 
ing to the inferences that they appeared to 
contain concerning the eight personal qual- 
ities. 

The response, for example, “I don’t get 
annoyed when other people prefer their own 
plans to mine if I can see that their plan is 
better,” appeared to reflect the student’s 
adaptability and was, as a consequence, 
placed under that head in the digest. 

The remarks of another interviewee 
seemed to express something about her sys- 
tem of values: “I want to be successful and 
happy. I would like very much to do as well 
as I can. If I don’t get married, I would like 
to go on with my studying, and I want to 
make a place for myself, to be comfortable, 
and make others like me.” Apparently asso- 
ciated with work habits was the comment, “I 
don’t like all this reading for literature 
courses. It takes so much time.” The replies 
to many of the questions of the interview 


* See original report on file, Library, University of Wisconsin 
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appeared to be related to two or more per- 
sonal qualities and were consequently re- 
peated under several headings in the digests. 

Six weeks after they had completed the 
evaluations of the interviews, the raters were 
given the interview digests. Two of the raters 
did not know when they read the interviews, 
that the material would be submitted to them 
again. The instructions (Appendix C-3)* and 
procedure were similar to those for the evalu- 
ations of the interviews with the exception 
that it was suggested that the rater check 
each quality as he finished the section devoted 
to it in the digest. Revisions were permitted 
after completion of the entire digest. 

The Pearson product-moment coefficients 
of correlation of the ratings (Appendix C, 
Tables Cro—C13)* with the criterion of 
supervisory ratings of teaching efficiency are 
shown in Table IX. Of the 36 coefficients, 
only four are significant at the one per cent 
level and seven others at the five per cent 
level. Three of these are for the mean ratings 
of the eight qualities and four are for the 
composites of the three raters. The evalua- 
tions of work habits are more closely related 
to the criterion than those for any of the 
other seven qualities. The composite of the 
mean ratings is correlated with the criterion 
to the extent indicated by a coefficient of 
.328 + .118. When the influence of the teach- 
ing situation is accounted for, the partial cor- 
relation of the composite with the criterion is 
.346 + .118, which is significantly different 
from zero at the one per cent level. 

A comparison of Table IX with Table VI 
brings out the point that, in the main, the 
ratings made on the basis of the interviews 
are more closely associated with the criterion 
than those made on the basis of the digest. 
The correlation between the composites of the 
mean ratings made from the two kinds of 
materials, the interviews and the digests, is 
659 + .075 and is significantly different 
from zero at the one-thousandth of one per 
cent level. 

When the criterion of pupil evaluation is 
used with the digest ratings (Table X), only 
one coefficient reaches the one per cent level 
of significance. That is for rater 3’s estimates 
of professional judgment. The means of the 
ratings display a slight degree of consistency 
in their relation to the criterion. The coeffi- 
cient of partial correlation for the composite 


“ See o-ginal report on file, Library, University of Wisconsin. 
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TABLE IX 


ZERO-ORDER COEFFICIENTS OF CORRELATION, 


THEIR ERRORS, AND SIGNIFICANCE LEVELS For Tue 


QUALITIES AND THE COMPOSITE For THE INTERVIEW DIGEST RATINGS 
AND THE CRITERION OF SUPERVISORY RATINGS* 


Rater 1 
r E. 


Qualities 
Adaptability - 
Considerate- 

=a 
Energy - . 
Initiative 
Professional 

Judgment 
Social 

Adequacy 
System of 

Values... 
Work Habits 
Mean of 8 

Qualities 58 


.176 (19) . 
.202 (13) 127 
. 252 ( 6). 
. 167 (21) .129 
.213 (11) .126 


.263 ( 5) .123 
.458 ( 1) .105 . 381 


-351 (1) .116 


Se & & S828 BS Z 


Rater 2 
r 


.002 (99) . 132 
-181 (18) . . 134 (32) .130 .174 (19) . 
.057 (67) .132 . 192 (15) 
.310 ( 2) .120 . 136 (31) . 

. 342 ( 2) .117 . 134 (32) . 130 
.207 (12) .127 


.052 (70) .182 
(1) .118 .192 (15) .128 


.297 ( 3) .121 - 150 (26) .129 


Composite of 
Rater 3 3 Raters 
E- r E. r E, 


. 062 (65) . . 121 (87) .130 
. 224 (10) .127 
- 128 - 181 (18) .128 
. 301 ( 3) .120 
.272 ( 5). 
.026 (85) . 132 . 206 (13) .1: 


—. 002 (99) . 132 . 162 (23) . 1: 
439 ( 1) .107 


. 328 ( 2). 


* Numbers in parentheses indicate significance levels expressed as per cents. 


TABLE X 


ZERO-ORDER COEFFICIENTS OF CORRELATION, 


THEIR ERRORS, AND SIGNIFICANCE LEVELS FoR THE 


QUALITIES AND THE CoMPosITe For THE INTERVIEW Dicest RATINGS 
AND THE CRITERION OF PUPIL EVALUATION* 


Rater 1 
r E r 


.192 (18) .18 
. 282 ( 5). 


Qualities 
Adaptability 
Considerate- 

ness 


Rater 2 
275 ( 6) .132 .156 (28) .139 
. 149 (30) .140 .181 


Composite of 
Rater 3 : 
E, r E. r 


.260 (7 
(21) .138 . 286 ( 5) 


.028 (85) .143 . 167 (25) 


. 186 (20) .138 . 164 (26) .139 
. 253 ( 8) . 1 


. 165 (25) . .318 ( 3) .128 . 136 (35) .140 
.172 (23) .139 . 204 (16) .137 411 (1) .119 . 328 ( 3). 
.316 ( 3) .129 .168 (25) .139 . 142 (33) .140 . 223 (12) .1i 


.286 ( 5) .131 .121 (40) .140 .074 (61) .142 . 226 (12) .1% 
. 156 (28) .139 .023 (88) .143 .127 (38) .141 -119 (41) . 


Energy 
Initiative 
Professional 
Judgment 
Social 
Adequacy 
System of 
Values 
Work Habits 


S$ Ss SSF sz 


Mean of 8 
Qualities - 50 .312 ( 3) .129 


.266 ( 7) .133 


. 247 ( 9) .134 .317 ( 3). 


* Numbers in parentheses indicate significance levels expressed as per cents. 


of the mean ratings and the criterion, with 
the difficulty of the situation held constant, is 
.332 + .128. This, like the zero-order coeffi- 
cient, .317 + .128, is significant at the three 
per cent level. 

As is true of the correlations between the 
criterion of pupil gain and the evaluations of 
the raters on the interviews, those between 
the interview-digest ratings and that criterion 
(Table XI) emphasize the lack of agreement 
between the subjective and objective evalua- 
tions. There may be doubt concerning the 
factors that are being measured and the de- 
gree of reliability with which they are meas- 


ured. There is little doubt, however, that the 
two approaches are not measuring the same 
aspects of the teacher’s ability and perform- 
ance. 


THE AUTOBIOGRAPHIES 


Another source of data used in the study 
was educational autobiographies prepared by 
39 students as an assignment in the course in 
Education 73, The Child: His Nature and 
His Needs. Mimeographed instructions (Ap- 
pendix A-14)* were given to each student 
setting forth the purpose of the assignment 

* See original report on file, Library, University of Wisconsin. 
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TABLE XI 


ZeRO-ORDER COEFFICIENTS OF CORRELATION, THEIR ERRORS, AND SIGNIFICANCE LEVELS For THE 
QUALITIES AND THE COMPOSITE FoR THE INTERVIEW DIGEST RATINGS 
AND THE CRITERION OF PUPIL GAIN* 


N Rater 1 
Qualities r E, r 


. 354 


Adaptability 17 .002 (99) .250 .112 
Ene 17 
ied .210 (41) .239 . 072 
Judgment 17 
System of 
17 . 124 (68) . 246 
Mean of 8 
. 189 


Considerate- 
ness _ - 17 .198 (43) .240 
. 386 (13) .213 
Initiative - 17 
Professional 
.089 (73) .248 . 194 
Social 
Adequacy 17 .053 (84) .249 .181 
Values 
Work Habits 17 .076 (77) .249 
Qualities 17 .062 . 249 


(81) 


Rater 2 


(66) 

.103 (69) 
—.028 (92) 
(78) 
(44) 
(47) 


. 039 (88) 
(16) 


(45) 


ite of 
ters 


Com 

Rater 3 3 

E, r E, r 
.247 —.258 (81) .2833 —.067 (79) 


. 247 .014 (96) .250 . 149 (56) 
. 250 .155 (54) .244 —.207 (41) .239 
. 249 .110 (66) .247 .173 (49) . 243 
.241 —.267 (29) .232 .004 (99) . 
. 242 .094 (71) .248 . 152 (55) . 


-250 —.142 (58) .245 —.001(100) . 
.219 . 221 (38) .238 . 267 (29) . 


.241 —.043 (87) .250 .083 (74) . 


. 249 
. 244 


* Numbers in parentheses indicate significance levels expressed as per cents. 


and suggesting possible questions that might 
be considered in the areas of abilities, rela- 
tionships with teachers and other members of 
school faculties, relationship to companions in 
school, activities related to school, and guid- 
ance. As was suggested in the instructions, the 
students did not attempt to answer the ques- 
tions in the order in which they were put: 
neither did they make an effort to supply 
reactions to all the questions. 

The autobiographies were read by three 
raters who had had considerable experience 
in the employment and supervision of teach- 
ers. The instructions to the raters of the auto- 
biographies (Appendix C-4)* included: 


Eight personal qualities have been se- 
lected for study. They are rather generally 
associated with success in teaching. You 
are asked to give your impression of the 
degree to which the candidate possesses 
each of these qualities, as you would esti- 
mate it upon the basis of the material in 
the autobiographies and your experience 
with teachers. 

Read over the autobiography for each 
candidate carefully. Then take a scale of 
personal qualities and check it on the five- 
point scale according to the impressions 
that you have gained from the autobiog- 
raphies. You may re-read any sections. 


Some of the autobiographies contained 
statements directly related to the qualities of 
the rating scale. Case 3, for example, made 
the following summary of her work habits: 


I do not like to leave projects before they 
are completed. With few exceptions, I have 
always managed to get my assignments in 
on time. My conscience never seems quite 
satisfied until a task is completed. I also 
believe one can do a much better job if he 
sticks to it while he still has the same spirit 
of enthusiasm with which he started. 


Shedding light upon her system of values, 
Number 12 observes: 


After eighth grade, I automatically put 
teaching down as my profession—nothing 
else has or ever will appeal to me. Its pos- 
sibilities are unlimited; its doors are open. 
I will never make money, people tell me, 
but after all, those professions with money 
in them won’t afford the earner the pleasure 
of reaping, intellectually, the seeds he has 
sown in the young and fertile. 

I have cast my lot in with youth and 
that means the future. The best part of all 
is that in such company, I can never grow 
old. 


Number 54 reveals something about her 
energy, motivation, and work habits: 


I have always aimed toward success in 
all that I set about to do. I shall never feel 
quite at ease unless everything that I have 
started is finished. This makes for a con- 
tinual strain—I am always starting some- 
thing and I must finish it—so there is 
always so much to be done . . . 
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TABLE XII 


ZERO-ORDER COEFFICIENTS OF CORRELATION, THEIR ERRORS, AND SIGNIFICANCE LEVELS For THE 
QUALITIES AND THE COMPOSITE FoR THE AUTOBIOGRAPHY RATINGS AND 
THE CRITERION OF SUPERVISORY RATINGS* 


Rater 1 
Qualities r E. r 
Adaptability - .351 ( 4). 
Considerate- 
.048 (77) . 


-197 23) .156 
. 373 ( 3). 


. 360 ( 3) .141 
. 209 (20) .155 


.060 (72) . 162 
.431 ( 1) .182 


. 136 


. 220 


Initiative ____ 
Professional 
~ = ememane 7 
a 


Adequacy - - 
System of 

Values_.... 39 
Work Habits 39 
Mean of 8 

Qualities 39 


. 209 


.401 (2 


Rater 2 
E, 
—.022 (90) . 
(18) . 
. 222 (18) 
.825 ( 5). 
. 385 ( 2) 
.200 (22) 


(20) 
. 260 (11) .151 


. 275 (10) 


Composite of 

Rater 3 3 Raters 
r E, r » 
.170 
.217 
. 237 
. 397 


.617 (1). 


(30) . 158 


(20) .155 
(15) .153 


( 2) .137 


.078 (64) .161 
.205 (21) .155 
.140 (39) .159 
. 255 (12) .152 
.313 ( 6) .146 
.174 (29) . 157 


. 160 
. 162 


. 134 


. 154 


. 138 
. 156 


. 155 .121 
. 029 


.416 (2 


(46) 
(86) 


. 150 


* Numbers in parentheses indicate significance levels expressed as per cents. 


I have a terrific amount of ambition— 
my only regret is that there are only 
twenty-four hours in every day. 


These excerpts from the autobiographies 
have been inchuded here to give the reader 
some insight into the type of material which 
the raters used in formulating their judg- 
ments. A complete autobiography is included 
in Appendix A-15.* Some of the papers were 
only a few pages in length, others contained 
more than 4,000 words. It is not inferred that 
all the material was as revealing as the ex- 
amples cited. In many instances, inferences 
for the evaluation of particular personal qual- 
ities were relatively obvious; in others the 
judgment of the rater played a more impor- 
tant role in drawing the inferences and in 
making the evaluations of potential qualities. 
In some cases, decisions may have been made 
upon the basis of limited data. Although such 
judgments tend to lack the validity of those 
made upon the basis of more complete evi- 
dence, they serve well for this investigation, 
which has as its purposes to consider the 
value of subjective data such as autobiogra- 
phies for the prediction of future success in 
teaching. The shortcomings in the data as well 
as in the evaluation of them must be consid- 
ered as factors limiting the value of such 
materials as instruments of prediction. 


As in the case of the interviews and the 


interview digests, the evaluations made by the 
three raters (Appendix C, Tables C14—C17)* 


* See original report on file, L brary, University of Wisconsin 


were correlated with the three criteria. Only 
10 of the 36 coefficients (Table XII) are sig- 
nificantly different from zero at the five per 
cent level and only two of these at the one 
per cent level. Initiative, professional judg- 
ment, and the mean of the eight qualities dis- 
play considerably more relationship to the 
criterion than do the other factors. The coeffi- 
cient for the composite of the mean judg- 
ments of the three raters, .376 + .139, be- 
comes .394 + .139 when the difficulty of the 
teaching situation is held constant. 

The coefficients (Table XIII) obtained 
when the raters’ estimates based on the mate- 
rial and implications of the material in the 
autobiographies are correlated with pupil 
evaluation lack significance and consistency. 
Only in three scattered instances do they 
reach the five per cent level of significance, 
and only in four others the ten per cent level. 
For the partial correlation of the composite 
of the mean ratings with this criterion, when 
the difficulty of the situation is held constant, 
the coefficient of .342 + .158 possesses sig- 
nificance at only the six per cent level. The 
zero-order coefficient for this correlation is 
329 + .160. 

Like Table XI, which shows the coefficients 
for the correlations between the ratings made 
from the interview digests and the criterion 
of pupil gain, Table XIV calls attention to 
the absence of relationship between the judg- 
ments of the raters and teaching success as 
measured by the criterion of residual pupil 
gain. Seventeen of the coefficients of correla- 
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TABLE XIII 


ZeRO-ORDER COEFFICIENTS OF CORRELATION, THEIR ERRORS, AND SIGNIFICANCE LEVELS For THE 
QUALITIES AND THE COMPOSITE For THE AUTOBIOGRAPHY RATINGS AND 
THE CRITERION OF PUPIL EVALUATION* 


N Rater 1 
Qualities : r E, r 
Adaptability _ 32 .072 (69) . . 334 
Considerate- 
—.020 (92) . . 180 


ness _ - 32 
$2 .265 (14) .164 .101 
. 200 


. 372 ( 4). 

.139 (44) .173 . 283 

. 290 . 162 . 048 
. 219 


.106 (56) .175 
. 167 (36) .172 


.296 (11) .161 


Initiative - - - - 
Professional 
Judgment.. 32 
Social 
Adequacy.... 32 
System 0’ 
Values__- 32 
Work Habits 32 
Mean of 8 
Qualities... 32 


(11) 


. 205 


Rater 2 


( 7) 
(32) 
(58) 
(27) 
(12) 
(79) . 


(23) 
.075 (68) 


(26) 


ite of 
aters 


Com 
Rater 3 3 
r E, r 


-116 (52) .177 - 278 (13) 
—.010 . 180 -091 (62) 
. 295 . 164 . 253 (17) 

. 282 . 165 . 344 ( 6) 

. 241 ( . 169 . 831 ( 7) .160 

. 151 . 236 (20) .170 


. 170 -272 (14) . 
. 166 - 221 (22) . 


. 157 . 829 (7). 


- 166 


.178 
. 168 
. 158 


- 160 
.174 
. 176 
.172 


- 165 


~ aus 
.179 


.172 


* Numbers in parentheses indicate significance levels expressed as per cents. 


TABLE XIV 


Zero-ORDER COEFFICIENTS OF CORRELATION, THEIR ERRORS, AND SIGNIFICANCE LEVELS For THE 
QUALITIES AND THE COMPOSITE FoR THE AUTOBIOGRAPHY RATINGS AND 
THE CRITERION OF PUPIL GAIN* 


N Rater 1 
E- r 


(30) .254 —.122 
(39) .261 —.082 
(79) .276 —.125 
(93) .277 —.050 
(92) .277 —.221 
(20) .242 —.143 


.220 —.039 
.277 —.162 


.257 —.139 


Qualities 
Adaptability _ 14 
Considerate- 

M...cs.. 
Energy ns 
Initiative.... 14 
Professional 

Judgment 14 
Social 

Adequacy 14 
System of 

Values 14 
Work Habits 14 
Mean of 8 

Qualities... 14 


r 
. 293 
. 240 
O77 
. 025 
. 031 
. 356 


. 456 
. 036 


. 271 


(11) 
(90) 


(34) 


Rater 2 


(66) 
(78) 
(66) 
(86) 
(43) 
(61) 


(89) 
(56) 


(62) 


site of 
ters 


Com 
Rater 3 
r 


—.015 
. 371 
.078 (78). 

—.039 (89) 
. 135 (63) 

—.225 (42) 


. 239 (39) .261 
.072 (80) .276 


.131 (64) .273 


r 
—.059 (84) 


.213 (45) 
. 000(100) 
—.028 (92) 
—.039 (89) 
.017 (96) 


. 803 (28) 
—.040 (89) 


-055 (84) 


276 
265 
977 
277 
277 
277 


. 255 
277 


. 276 


(96) .277 
(19) .23 

276 
. 276 
. 272 


. 263 


. 273 
. 275 
. 273 
277 
. 264 
. 272 


277 
. 270 


. 272 


* Numbers in parentheses indicate significance levels expressed as per cents. 


tion are negative, including all those for the 
evaluations of rater 2. The ratings for initia- 
tive made by each of the three judges and the 
composite for that quality all are correlated 
negatively with and are not significantly re- 
lated to the pupil gain criterion. 

The composite of the mean ratings of the 
eight qualities made upon the basis of the 
autobiographical materials are correlated with 
the composite of the mean ratings of these 
qualities made from the reports of the inter- 
views to the extent indicated by the coefficient 
of .648 + .094. This is significantly different 
from zero at the one-hundredth of one per 
cent level. The same level of significance is 


found for the relationship between the com- 
posite of the mean ratings of the autobiogra- 
phies and the composite of such ratings made 
upon the basis of the materials in the inter- 
view digests. The coefficient of correlation for 
these two variables is .681 + .087. 

The ratings made from the contents of the 
autobiographies appear to be less closely asso- 
ciated with supervisory ratings of teaching 
efficiency than are those based on the inter- 
views. Little correlation is found between the 
rating of the autobiographies and the criterion 
of pupil evaluation, and practically no rela- 
tionship is observed between these ratings and 
pupil gain. However, the evaluations made 
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TABLE XV 


ZERO-ORDER COEFFICIENTS OF CORRELATION, THEIR ERRORS, AND SIGNIFICANCE LEVELS For Seven 
ITEMS FROM THE DATA BOOKLET AND THE THREE CRITERIA* 


Ratings 


Size of home community - 


Total Per Cent of University Expenses» on 


.191 (17) 
(5) .139 


metineaed Cost for one Year at the 
Universit 
Hours per 
Number of ry 3 
Self-Appraisal of ealth_ 


-. 315 
eek Spent in Study. 


202 (15) 
(8) .129 


.049 (73) 
.074 (61) 
. 147 (29) 


Residual 
Pupil Gain 

r E. 
—.258 (32) . 
.044 (87) . 
.055 (84) . 
(85) . 


Pupil 

Evaluation 

r E 
. 146 
. 145 
. 143 
. 162 
. 149 


. 136 
. 139 


. 082 
. 134 
. 169 (26) 
. 167 (32) 
. 106 (49) 


-, 237 (11) 
. 243 (10) 


(59) 
(37) 


= 


. 132 


—! 155 
212 


- 141 
137 - 


.134 224 


* Numbers in parentheses indicate significance levels expressed as per cents. 


from the autobiographies are significantly re- 
lated to those made by the raters of the inter- 
views and the interview digests. 


SeEvEN Items From THE DATA BOOKLETS 


As has already been explained, a Student 
Data Booklet. (Appendix A-16)* was filled 
out by the subjects during their junior year 
at the University and a Supplementary Data 
Booklet (Appendix A-17)* during their 
senior year. From the information covering 
their home background, high school and col- 
lege experiences, vocational interests, recrea- 
tional and social activities, and work experi- 
ence, seven items were selected. They included 
the size of the community in which the stu- 
dents spent the major portion of their lives 
prior to filling out the data booklets, per cent 
of university expenses that each earned, par- 
ticipation in extra-curricular activities while 
in high school, estimated cost of one year’s 
attendance at the University, average number 
of hours per week spent in study, total num- 
ber of siblings, and the student’s self-appraisal 
of her health (Appendix C, Table C18).* 


In considering the size of the students’ 
home communities, a value of one was as- 
signed for each farm reported as the residence 
of one of the subjects; two for communities 
under 1,000 population; three for those be- 
tween 1,000 and 3,000; four for those be- 
tween 3,000 and 10,000; five for those from 
10,000 to 25,000; six for those between 
25,000 and 75,000; and seven for those above 
75,000. 


The calculations for high school participa- 
tion in extva-curricular activities were made 
* See original report on file, Library, University of Wisconsin. 


upon the basis of points. One point was given 
for each semester’s participation in any school 
organization or activity listed in the Student 
Data Booklet. Two points were added to the 
total for each instance in which the student 
had been the captain, editor, president, or 
other chief leader in the activity. One point 
was added for each office other than that of 
president and for other positions of minor 
responsibility. 

Where two different estimates were listed 
in the Student Data Booklet and the Supple- 
mentary Student Data Booklet for the total 
cost of one year’s attendance at the Univer- 
sity, the mean of the two was used. Nine stu- 
dents whose homes were in Madison were 
omitted for this item since their expenses were 
not comparable to those of the others. For 
the self-appraisal of health, “poor” was given 
a rating of one, “average” a rating of two, 
“good” a rating of three, and a rating of four 
was assigned for all those who made a special 
comment on the excellence of their health. 
Since the same item was included in the two 
booklets, the mean of the two appraisals was 
used in the consideration of the factor. 

The zero-order coefficients of correlation for 
the seven items with the three criteria were 
computed (Table XV). They reveal little re- 
lationship between the items and the criteria. 
Only one is significantly different from zero 
at the five per cent level, that for the esti- 
mated cost for one year’s attendance at the 
University with the criterion of supervisory 
ratings. It will be noted that the relationship 
is negative. Total per cent of University ex- 
penses earned is positively related to the same 
criterion at the eight per cent level, and the 
coefficient of correlation between self-appraisal 
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TABLE XVI 


LEVELS OF SIGNIFICANCE FOR THE COEFFICIENTS OF CORRELATION FOR THE RATINGS OF 
SUBJECTIVE DATA WITH THE THREE CRITERIA* 


Criteria 
Supervisory Ratings 
Pupil Evaluation 
Residual ae Gain 
Tota 


2-5% 6-10% 
32 9 47 10 (3) 


Frequency of Significance Levels 

11-50% 51-100% 

11 10 66 (3) 26 (8) 

1 2 43 (10) 39 (30) 
21 156 (13) 75 (41) 


* Numbers in parentheses indicate frequencies for levels of significance for negative coefficients of 


correlation. 


TABLE XVII 
LEVELS OF SIGNIFICANCE OF COEFFICIENTS OF CORRELATION For RATINGS OF FIVE SOURCES OF 


INFORMATION WITH THE THREE 
Frequency of Significance Levels 
Qq 6-10% 11-50% 


1% 
With Supervisory Ratings 
Comments on Interviews with Vo- 
cabulary Analysis _ - _ - af 
Comments Without Analysis. os 
Interviews - - - ----- 
Interview Digests 
Autobi phies _ 
With Pupi Evaluation 
Coauninats on Interviews with Vo- 
cabulary Analysis ARCS ASE 
Comments Without Analysis_-- _- 
Interviews. _ _ - : 
Interview Di 


Autobi 
With Redied phic. Gain 
Comments on Interviews with Vo- 


cabulary Analysis - - oh 
Comments Without Analysis i 
Interviews _ - 
Interview Digests 
Autobiographies 


Per Cent___ 


of health is associated positively with the 
criterion of pupil evaluation at the ten per 
cent level. 


SUMMARY OF ZERO-ORDER COEFFICIENTS OF 
CORRELATION OBTAINED 


The significance levels of the coefficients 
of correlation for all the ratings of comments 
on the interviews with and without the analy- 
sis of vocabulary, statements of instructors, 
interview digests, and autobiographies with 
the three criteria used successively are in- 
cluded in Table XVI. The higher degree of 
relationship between the evaluations of the 
materials and the criterion of supervisory 
ratings than between the evaluations and the 
other two criteria is clearly indicated. When 


cr) oe 


a sa 
ee 6.8 

* Numbers in parentheses indicate frequencies for levels of significance for negative coefficients of 
correlation. 


1A* 


(4) 8 
(4) 17 

(2) 10 
152 (12) 73 


11.8 5.7 41.5 (3.3) 20 


supervisory ratings are employed as the index 
of teaching success, more than 44 per cent of 
the predictive estimates are significantly re- 
lated to teaching efficiency at less than the 
five per cent level. When pupil evaluation is 
used as the criterion, less than 10 per cent of 
the coefficients of correlation indicate a rela- 
tionship significantly different from zero at 
that level; and less than one per cent of the 
coefficients obtained through the use of the 
residual pupil gain criterion reach that level 
of significance. The data indicate that esti- 
mates of probable teaching success and of the 
qualities commonly associated with success, 
made upon the basis of materials such as 
those considered in this study, are more 
closely related to efficiency ratings made by 
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supervisors than to those made by pupils or 
those developed from residual pupil gain as 
measured by tests. 

Table XVII compares the relationship to 
the criteria of the five principal sources of 
subjective information that have been ana- 
lyzed: (1) the interviewers’ comments with 
vocabulary analysis, (2) these comments 
without analysis of vocabulary, (3) the inter- 
views, (4) the digests of the interviews, and 
(5) the autobiographies. 

The ratings for the interviewers’ comments, 
both with and without detailed study of 
vocabulary, and of the interviews yield sig- 
nificant coefficients when correlated with 
supervisory ratings. A number of the evalua- 


[Vol.15,No.1 


tions based on the interview digests and the 
autobiographies also appear to be significantly 
associated with that criterion. 

The ratings for the digests and the auto- 
biographies are more closely related to the 
criterion of pupil evaluation than are the esti- 
mates based on any of the other materials, 
Ratings for none of the data-gathering devices 
display relationship to the criterion of pupil 
gain. 

A summary of the frequencies of the sig- 
nificance levels for the coefficients of correla- 
tion of the ratings for the eight personal qual- 
ities considered in the analyses of the inter- 
views, interview digests, and autobiographies 
with the criteria is presented in Table XVIII. 


TABLE XVIII 


LEVELS OF SIGNIFICANCE OF COEFFICIENTS OF CORRELATION For RATINGS OF EIGHT PERSONAL 
QUALITIES BASED ON INTERVIEWS, INTERVIEW DIGESTS, AND 
AUTOBIOGRAPHIES WITH THE CRITERIA* 


Qualities 
Adaptability 
Supervisory Ratings_- 
Pupil Evaluation 
Pupil Gain __- 
Considerateness 
Supervisory Ratings-_- 
Pupil Evaluation__- 
I se nies ivan Seth des 
Energy 
Supervisory Ratings 
Pupil Evaluation 
Pupil Gain 
Initiative 
Supervisory Ratings -- 
Pupil Evaluation.............._..-. 
Pupil Gain _ 
Professional Judgment 
Supervisory - a : 
Pupil Evaulation_- 
x... il Gain - 


Adequacy 

a tings. 
Pupil Evaluation_- 
Pupil Gain - --- 

System of Values 
Supervisory Ratings....___._.__..._.______-. 
Pupil Evaluation 
Pupil Gain _ -- 

Work Habits 
Supervisory Ratings _- 
Pupil Evaluation 
Pupil Gain 

Mean of 8 Qualities 
Supervisory Ratings 
Pupil Evaluation 
Pupil Gain 


ns = of Levels 


11-50% 


wor ane dn ee> 
‘ 


3 
~ 20 130 (12) 
6.2 40.1 (3.7) 


66 (38) 

20.4 (11.7) 
* Numbers in parentheses indicate frequencies for levels of significance for negative coefficients of 

correlation. 
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TABLE XIX 
INTERCORRELATIONS AMONG SIX VARIABLES AND THE CRITERION OF SUPERVISORY RATINGS 


Xi 
1.000 
. 149 
—. 012 
.124 


X, Difficulty of Situation___- 

X, Composite of Interviews-__-- 
X, Composite Autobiography --- 
X, Comments on Interviews 

X ; Initiative . 052 
X Professional Judgment. ...... —. 136 
X» Supervisory Ratings- -- . —.331 


X: Xs 
. 149 
1. 000 
. 648 
- 482 
. 874 
- 485 
- 436 


Xs 
. 052 
. 874 
- 496 
- 447 
1.000 
. 356 
. 513 


Xs 
—. 136 
. 485 

. 784 

. 354 

. 856 
1. 000 


X« 
. 124 
- 482 
- 452 
1.000 
- 447 
. 354 
. 341 


—. 012 
. 648 

1. 000 

- 452 

. 496 

. 784 

. 376 


TABLE XX 


Beta COEFFICIENTS For Six FAcTtors WITH SUPERVISORY RATINGS AS THE CRITERION 
Cri. 
—. 331 


, Difficulty of Situation 
; Composite Interviews 
; Composite Autobiography 
, Comments on Interviews 
X ; Initiative 
X, Professional Judgment 
R for All Factors to this Point____- 


The absence of significant relationship be- 
tween the ratings for most of the qualities 
and the criteria, particularly pupil evaluation 
and pupil gain, is evident. The twelve evalu- 
ations for each quality included the judgments 
of three raters and the composite for each of 
the three sets of materials, the interviews, the 
digests, and the autobiographies. 

The mean of the ratings of three qualities, 
work habits, initiative, and professional judg- 
ment, are found to possess some positive rela- 
tionship to the criterion of supervisory 
ratings. Considerateness appears less closely 
related to that criterion than any of the other 
qualities. Worthy of note is the number of 
negative coefficients, although none of them 
reaches the 10 per cent level of significance. 


COMBINATIONS OF FACTORS 


In considering the relationship of a combi- 
nation of variables to the criteria, the inter- 
correlations were computed for (1) the diffi- 
culty of the situation, (2) the composite of 
the mean ratings for the interviews, (3) the 
composite for the autobiographies, (4) the 
mean evaluations of the interviewers’ com- 
ments without the analysis of vocabulary, 
(5) the composite judgments for initiative 
based on the interviews, and (6) the com- 
posite estimates of professional judgment 
made from the autobiographies. These inter- 
correlations are shown in Table XIX. 

When the matrix was solved through the 
use of Aitken’s Modified Method of Pivotal 


Xs 
—. 405 


Xe 
—. 293 
—. 099 
—. 287 


X; X4 Xs 
—.395 —.411 —.365 
. 439 .380 —.051 

. 037 . 107 

.161 


Condensation, the beta coefficients of Table 

XX were obtained. The regression equation 

for prediction in terms of z-scores, when six 

factors are used, is: 

2, == — .2932, — .0992, — .2872, + .1442, 
+ .5092, + .518z,. 


For the six items the coefficient of multiple 
correlation is .724+ .084, which is signifi- 
cantly different from zero at the one- 
hundredth of one per cent level.?* 

When pupil evaluation was used as the cri- 
terion, and the matrix of intercorrelations 
among the same variables was solved, the 
beta coefficients in Table XXI were obtained. 
The regression equation for predicting success 
as measured by pupil evaluation is: 

2, == — .2792, — .1772. + .2652, + .0222, 
+ .1692; + .1042, 


The multiple coefficient for the first three 
factors, .452 + .159, is increased only slightly 
to .461 + .157 through the addition of the 
comments on the interviews without vocabu- 
lary analysis, the composite ratings on initia- 
tive, and the composite evaluations of profes- 
sional judgment based on the autobiographies. 
The coefficient is significant at the three per 
cent level. 

The intercorrelations among the same 
factors and the criterion of pupil gain are 
shown in Table XXII. The beta coefficients 


2 The significance level was calculated in the same manner 
as that for the coefficients with the cxception that 
the number of independent variables plus one was subtracted 
from the number of cases. | 
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TABLE XXI 
Beta COEFFICIENTS For Srx Factors WitH PuPpit EVALUATION AS THE CRITERION 


X; 
—. 342 


X, 
X, Difficulty of Situation ....—. 310 
7. Composite Interviews _ seca card ies 
X; Composite Autobiography - 
X , Comments on Interviews - 
X, Initiative.____ : 
X. Professional Judgment - = 
R for All Factors to This Point 


X; Xe 


—. 306 


X« Xs 
—.309 —.293 
—.017 —.167 

. . 344 

. 025 
. 157 
456 


TABLE XXII 
INTERCORRELATIONS AMONG SIX VARIABLES AND THE CRITERION OF RESIDUAL PUPIL GAIN 


X, 
1 Difficulty of Situation. . 1.000 
2 Composite Interviews....__.__ —. 319 
3 Composite Autobiography _-_-_- 
« Comments on Interviews ____- 


¢ Professional Judgment 
o Pupil Gain_-__ _- 


X: X; 
—. 319 


Xs X, 
—. 303 
917 
. 281 
. 574 
1. 000 
. 265 


Xs 
—. 186 
- 702 
. 352 
1. 000 
. 574 
. 392 
. 354 


—. 220 
. 472 

1. 000 

. 352 

. 281 

. 876 

. 055 


TABLE XXIII 
Beta COEFFICIENTS For Srx Factors WITH RESIDUAL PUPIL GAIN AS THE CRITERION 


Xi 
1 Difficulty of Situation —. 237 
+ Composite Interviews. : 
3; Composite Autobiography - 
« Comments on Interviews 


s Professional Judgment. : 
R for all Factors to This Point_____- 


resulting from the solution of the matrix are 
given in Table XXIII. The coefficient of 
multiple correlation of .679 + .191 for the 
combination of the first five variables is 
lowered considerably by the addition of pro- 
fessional judgment as rated from the auto- 
biographies. The predictive value of the 
coefficient is limited because of the small 
number of cases involved. The regression 
equation employing the five factors is: 
2, == — .2782, + 1.2182, — .3142, 
+ .3752, — 1.4212;. 

When four variables are considered with 
the criterion of supervisory ratings; namely, 
(1) the difficulty of the situation, (2) the 
composite estimates of initiative, (3) the com- 
posite evaluations of professional judgment, 
and (4) the composite of the mean ratings of 
all qualities based on the interviews, the beta 
coefficients of Table XXIV result. The coeffi- 
cient of multiple correlation for the four inde- 
pendent factors is .702 + .ogo and is sig- 
nificantly related to supervisory ratings at the 


Xs 


Cri. 
—. 237 


Xs 
—.278 
1.214 2.874 
—.314 1.072 
. 3875 —1.015 
—1. 421 —1. 680 
; —1. 804 
. 679 . 438 


Xe 
. 332 


X; 
—.224 


X« 
—. 248 
—. 335 
—. 038 

- 556 


. 463 


one-hundredth of one per cent level. The 
coefficient for the combination of the first 
three items is .695 + .og1 and has approxi- 
mately the same level of significance as the 
one resulting from the addition of the fourth 
variable. The regression equation employing 
the four factors is: 


2, = — .2798, + .5782, + .3768, — .2093,. 


That for the three is: 
2, == — .3082, + .4132, + .3282,, 


in which the independent variables are (1) 
the difficulty of the situation, (2) the com- 
posite of the judgments of the interview 
raters for initiative, and (3) the composite 
estimates of professional judgment arrived at 
from a consideration of the autobiographies. 
If the difficulty of the situation is omitted 
and the remaining three variables are used in 
the order mentioned, the coefficient is .649 + 
102, with a significance level of one-tenth of 
one per cent. The combination of two factors, 
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TYPES OF PERSONAL DATA EMPLOYED 


TABLE XXIV 


Beta COEFFICIENTS For Four INDEPENDENT VARIABLES WITH SUPERVISORY 
RATINGS AS THE CRITERION 


X, Difficulty of Situation_. 
xX; Jnitiative.........- 
Xs Professional Judgment _ - 
, Composite Interviews 
R for All Factors to This Point 


initiative and professional judgment, yields a 
coefficient of .625 + .108, which is also sig- 
nificant at the one-tenth of one per cent level. 


SECTION IV 
SUMMARY AND CONCLUSIONS 


The major purpose of this study was to 
investigate the relationship between certain 
types of personal data gathered during the 
period of the students’ professional education 
and future success in teaching. The investi- 
gation was principally a correlation study de- 
signed to ascertain the predictive value of 
subjective materials including: 


(1) Comments recorded by members of the 
staff of the Department of Education, 
University of Wisconsin, who con- 
ducted two planned interviews with 
the students. 

Statements of instructors in the De- 
partment of Education concerning the 
students’ probable future success as 
teachers. 

General evaluations of the candidates 
made by supervisors of their school 
and community activities and their 
work in practice teaching. 
Stenographic reports of two 40-minute 
interviews conducted according to 
procedures previously worked out by 
the interviewers. 

(5) Digests of the interviews, in which re- 
sponses were classified according to 
their inferences for eight personal 
qualities. 

(6) Educational autobiographies written 
by the students during their junior 
year at the University. 


In the analysis of the materials, considera- 
tion was given to eight personal qualities or 
behavior patterns commonly associated with 
teaching success and rated as essential for 
effective instruction by a selected group of 


Cri. 
—. 331 
- 513 
- 517 
. 436 


X« 
—. 279 
. 578 
. 376 
—.209 
- 102 


X: X; 
—. 359 
_ 68 


—. 308 


school administrators. These qualities were: 
(1) adaptability, (2) considerateness, (3) 
energy, (4) initiative, (5) professional judg- 
ment, (6) social adequacy, (7) system of 
values, and (8) work habits. 

The subjects were 58 women teachers, all 
graduates of Wisconsin high schools and of 
the University of Wisconsin, whose first-year 
teaching assignments were in Wisconsin high 
schools. 

Three criteria of teaching efficiency were 
employed: (1) a composite of five supervisory 
ratings, (2) evaluations made by pupils in the 
classes taught by the subjects, and (3) re- 
sidual pupil gain as measured by standardized 
tests. 

What may appear to be inconsistencies in 
the results of the study may be traceable to 
selective factors operating in the sample of 
teachers, to the subjective nature of the mate- 
rials, to the complex nature of teaching itself, 
or to the fact that the three criteria are not 
measuring the same aspects of the teacher’s 
activities. 

Subject to the limitations imposed by these 
factors, the following conclusions seem war- 
ranted: 

1. Predictions made upon the basis of sub- 
jective data of the sort here employed appear 
to be significantly related to supervisory 
ratings of teaching success. Of 25 coefficients 
of correlation possessing significance at the 
one per cent level, 24 result from the employ- 
ment of this criterion. 

2. The evidence indicates that estimates of 
personal qualities and of probable teaching 
success, arrived at from a study of such mate- 
rials as interviews, autobiographies, and com- 
ments of instructors, are not closely associated 
with effectiveness as gauged by the evaluation 
of pupils or by residual pupil gain as meas- 
ured by tests. Only five per cent of the cor- 
relations with these criteria yield coefficients 
significant at the five per cent level. 

3. The materials which appear to possess 
most promise for the prediction of effective- 
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ness in teaching as measured by estimates of 
supervisors are the interviews and the com- 
ments of the interviewers. 

4. Among the personal qualities considered, 
work habits, initiative, and professional judg- 
ment seem to be the ones whose contribution 
to teaching success can be most effectively 
identified and evaluated. 

5. Either considerateness contributes rela- 
tively little to teaching efficiency, or its pres- 
ence or absence in the candidate cannot be 
detected from materials such as those studied. 

6. A coefficient of multiple correlation of 
.724 is found for six factors, one of .702 for 
four, and .695 for three when supervisory 
ratings are taken as the index of success. 

7. The relationship between the predictive 
evaluations and the criteria are increased con- 
sistently when the difficulty of the teaching 
situation is held constant. 

8. There is evidence of considerabie agree- 
ment among the ratings of judges on the dif- 
ferent types of materials. The coefficients for 
the intercorrelations, for example, between the 
evaluations based on the interviews, the inter- 
view digests, and the autobiographies are all 
significant at the one-hundredth of one per 
cent level. 

9. Judges are better able to predict success 
in the field as measured by supervisory ratings 
when their evaluations are made from the 
stenographic reports of the interviews them- 
selves than when their estimates are based 
upon digests of the interviews such as were 
employed in this study. 

10. There is some indication that the 
ratings made from the interview digests are 
somewhat more closely related to the criterion 
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of pupil evaluation than are those based on 
the interviews themselves. 

11. Evaluations of comments made by in- 
terviewers concerning qualities and potential 
capacity for teaching are as closely associated 
with the criteria when they are made upon 
the basis of careful reading as when the lan- 
guage habits and vocabulary of the inter. 
viewers are analyzed in detail. 

12. Evaluations of the interviewers’ com- 
ments made by two raters upon the basis of 
independent analyses of the vocabulary dis. 
play consistency to the extent indicated by 
the coefficient of correlation of .874. 

13. The composite evaluations of the inter- 
viewers’ with and without analysis of vocabu- 
lary are found to correlate to the extent of 
O15. 

14. There is some indication that the reac- 
tions of interviewers are more closely related 
to the criteria than are those of instructors 
and of activity and practice teaching super- 
visors. 

15. None of the seven items taken from 
the data booklets appear to be significantly 
related to success in teaching. 

In general, the analysis of the data empha- 
sizes the lack of agreement between subjective 
and objective measures. There is considerable 
evidence to indicate that the two approaches 
to the prediction and evaluation of teaching 
effectiveness are not taking into account the 
same aspects of the teacher’s ability and per- 
formance. The higher degree of relationship 
between the evaluations of subjective mate- 
rials and the criterion of supervisory ratings 
than between these evaluations and the other 
two criteria is clearly indicated. 














THE PREDICTION OF TEACHING EFFICIENCY FROM 


OBJECTIVE MEASURES 


RONALD DEVALL JONES* 
Olivet Nazarene College 


SECTION I 
STABEMENT OF THE PROBLEM 


The administration of selection and guid- 


ance pfegrams with reference to prospective 
teacherg is dependent largely upon the use of 
reliable and valid measuring devices. To get 
such measures and to establish their relation- 
ships to valid and reliable criteria of teaching 
efficiency has not been an easy undertaking. 
The complexity of the teaching act has added 
to the difficulty of accurate measurement and 
prediction in this area. Until recent years, in- 
vestigators have been satisfied to rely upon 
subjective estimates of teaching efficiency as 
criteria\ of success and subjective measuring 
devices to indicate progress in learning to 
teach. 

While this investigation deals with both 
subjective and objective techniques of meas- 
uring teaching efficiency, emphasis is placed 
upon the objective techniques in hopes that 
more reliable information useful in prediction 
of teaching success may be discovered. The 
criteria of efficiency in teaching employed in 
this investigation are: (1) supervisory rating; 
and (2) pupil gain scores. 


The central purpose of this investigation is 
to determine the factors discernable in pre- 
service education of individual teacher- 
candidates that are significantly related to 
later success in teaching. More specifically, 
this study is an attempt to answer the follow- 
ing questions: 


(1) Of what value are certain data col- 
lectable about each person at the time 
of his entrance into the university for 
predicting teaching success as meas- 
ured by supervisory ratings and pupil 
gain criteria? 


* The author gratefully acknowledges the assistance rendered 
by Dr. A. S. Barr, Professor of Education, University of 


Wisconsin, and member of the Teacher Personnel Research 
Committee for aid received. 


Kankakee, Illinois 
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(2) Of what value are certain data col- 
lectable during the period of pre- 
service teacher education at the Uni- 
versity of Wisconsin for predicting 
teaching success? 

What relationships are to be found in 
the data which may be of significance 
for more adequate selection and train- 
ing of prospective teachers? 


(3) 


SECTION II 


EXPERIMENTAL DESIGN AND 
PROCEDURE 


This study is one of a series of investiga- 
tions undertaken under the leadership of the 
Teacher Personnel Research Committee of 
the University of Wisconsin. In order to per- 
mit intercomparisons, the design, measuring 
instruments, and procedures are similar to 
those employed in other studies. 

The bases for the selection of the teachers 
who cooperated in furnishing data were: 


1. That they were graduates of the Univer- 
sity of Wisconsin, School of Education. 

2. That the year of graduation was 1941, 
1942, OF 1943. 

3. That relatively complete information 
was on file with the Teacher Personnel 
Research Committee or available in 
other university records. 

4. That these graduates were currently em- 
ployed as teachers in the state of Wis- 
consin. 

5. That they were recipients of the Wis- 
consin State Teachers Certificate. 


Of nearly 750 graduates considered, only 
65 were chosen. This relatively small sampling 
was due in part to World War II conditions. 
Of this group, 57 were women and eight were 
men. These 65 teachers were located in 36 
different schools and were teaching in 15 sub- 
ject areas; namely, art, chemistry, English, 
social studies, mathematics, physical educa- 
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TABLE I 
ACHIEVEMENT TESTS ADMINISTERED 


Fundamental Abilities of Visual Art 
Cooperative Chemi 
rative Engli 
echanics of 
Cooperative Englis 
Test B1, Form T 


ression Test A, Form T 


Cooperative Algebra through Quadratics, Revised Series, 


Wisconsin Achievement Test in Plane Geometry, Form A_- 


Kniss World History Test, Form A 


yee ene American History Test, Revised Series, Form S _ 
Revised Series, Elementary Form 0. 


rative — Test, 
Wa ‘eld-Walther Geography, Form A 
Wrightstone Scale of Civic Beliefs Test, Form A 
Cooperative Gene 


Cooperative Latin Test, Lower Level, Form S 


Cooperative Biology Test, Revised Series, Form S_______- = = 


Providence Inventory Test in Music, Form A 
Totals 


ral Achievement Test of General “+ need 
in the field of Social Studies, Revised Series, Form T - 
Wisconsin Achievement Test in General Science, Form A_ 


Numberof Number of 
pupils given pupils given 
pre-test post-test 
188 102 
25 23 


572 
572 
69 


34 
181 


Number of 
cl 


Test, Effectiveness of Expression, 


8 em no encom COM mA ro 


CLASSES FroM WHICH No Post-Test ScorRES WERE RECEIVED 


Teacher number 


tion, geography, general science, agriculture, 
home economics, history, speech, music, lan- 
guages, and biology. 

The records of each teacher were consulted 
and data compiled with reference to the fol- 
lowing factors, which were thought to be im- 
portant to success in teaching: 

1. University Grade Point Average. The 
actual grade point averages were calculated 
using the scale: A = 3 grade points, B = 2 
grade points, C = 1 grade point, D = o 
grade point, F —- —'% grade point. Grade 
point averages were considered individually 
in some cases such as: 

a. Freshman, sophomore, junior, and senior 

taken individually and as a composite. 


Number of 
pupils 


Test 
administered 
FAVA 
CoME 
CoEE 
CoSp 


CoAmHist 


b. Grade point average for Education 73, 
The Child: His Nature and His Needs; 
Education 74, The School and Society; 
and Education 75, The Nature and Di- 
rection of Learning; taken separately 
and combined. 

. Practice teaching in the major and in 
Education 75. Practice teaching grades 
were assigned by the critic teachers and 
two separate grades were usually re- 
ported in two different semesters usually 
in a different subject and by different 
critics. 

2. Rank In High-School Class. The per- 

centile ranks were converted to T-scores. 
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TABLE III 
DEVELOPMENT OF PUPIL GAIN CRITERION 


Pre-Test MA 
Zi 
2. 5064 
1. 4830 
- .7070 
— .0450 
. 5994 
— . 7623 
. 1070 
. 1480 
- . 8056 
. 1472 
— , 4510 
. 4064 
. 0410 
. 1330 
. 2181 
. 2833 
. 0456 
. 7070 
. 4840 
. 1140 
- .7144 
. 9080 
~1. 1959 
0000 


. 2880 
. 9760 
. 5059 
. 7070 
. 1660 
— .2939 
— .2450 
. 4645 
— .3290 


*zo=.081z ,—.060z.+.02I1z;. 


Teacher No. 


3. The Henmon—Nelson Test of Mental 
Ability. These scores were recorded according 
to percentile distribution. 

4. American Council on Education Coop- 
erative English Test. This test consists of 
vocabulary, speed and comprehension, and 
level of comprehension and was administered 
to the students of the School of Education. 

5. American Council on Education Psycho- 
logical Examination For College Freshmen, 
composed of six divisions: arithmetic, analo- 
gies, number series, completion, artificial lan- 
guage, and same-opposite. 

6. American Council on Education Coop- 
erative General Culture Test, consists of sub- 
tests of current social problems, history and 
social problems, literature, fine arts, science, 
and mathematics. 

7. The Bell Adjustment Inventory. The 
total score as well as the individual a, b, c, 
and d scores were used. 


— [610 


IQ Gain-Mo. 

Zs Zz 

— .2396 

— .0958 
. 0074 
. 1418 


1.370 
. 531 


. 993 
.473 
. 055 
. 227 
. 156 


- 914 


. 156 
. 346 
. 148 
. 505 
. 222 
. 134 
.121 
. 703 
. 069 
. 988 
.424 
. 156 
. 137 


— .703 
- . 690 


. 107 


- .240 


. 029 


— 021 


.077 
. 544 
. 896 
.077 
. 148 


8. The Link Inventory of Activities and 
Interests. The X, SI, SX, SD, and ESD were 
recorded separately. 


THE CRITERION OF TEACHING EFFICIENCY 


Two criteria of teaching efficiency were 
used: (1) supervisory rating, and (2) re- 
sidual pupil gain. Through the cooperation of 
the principals of the schools in which the indi- 
viduals studied were teaching, ratings were 
obtained of each teacher’s efficiency. The 
principals were given two teacher rating 
blanks to fill out for each teacher: (1) Wis- 
consin Adaptation, “M” Blank, and (2) Guide 
Sheet C (Appendix III).* Of the 65 sets of 
rating blanks mailed, 55 were returned and 
usable. Because of the high positive correla- 
tion between ratings made on the two blanks 
(.981 + .000), Guide Sheet C was not used. 
The second criterion was that of pupil gain. 

* See original report on file, Library, University of Wisconsin. 





JOURNAL OF EXPERIMENTAL EDUCATION 


[Vol. 25, No.1 


TABLE IV 


DEVELOPMENT OF PupPIL GAIN CRITERION USING MEANS AND SIGMAS TAKEN FRoM 
PUBLISHED ACHIEVEMENT TEST NoRMS 


ahah at hd ttl at adel ad Asal of of of of of of shal of of aot 


. 069 
4.935 


.089z , + .669z .—.560z ;. 


PORNO RD Cot ee RD et DRO tt te 


*Zo= 


It was hoped that it would be possible to 
secure measures of pupil gain through the use 
of standardized tests for at least one class 
taught by each teacher. This did not prove 
feasible since it was impossible to secure satis- 
factory standardized tests in all fields, partic- 
ularly in the fields of home economics, physi- 
cal education, agriculture, speech, and health. 
Course work in these areas was not found to 
be sufficiently uniform throughout the state 
to make it practicable to set up a testing pro- 
gram on any given unit in either of these 
areas. Of necessity, then, achievement tests 
were not administered in the classes of 18 of 
the 65 teachers. 

Standardized tests were administered to the 
pupils in 83 classes in the subject areas of art, 
chemistry, English, algebra, geometry, world 
history, American history, geography, civics, 
Latin, general science, Spanish, biology, 
French, and music. Complete data for this cri- 
terion were received relative to 33 teachers 
when the means and sigmas of the individual 
groups were used, and for 29 where the means 


Predicted Residual 

Gain* Gain 
Zo Z-Z 0 
. 975 — .804 
. 048 .176 
. 072 . 147 
. 506 .714 
. 476 . 510 
. 261 .121 
. 454 . 560 
. 225 . 120 

- ,836 . 681 
. 506 . 687 
.127 . 002 
.118 . 003 
. 467 . 633 
. 465 . 571 
. 236 

- .113 
. 162 
. 807 
.211 
. 154 

- , 820 
. 338 
. 639 
. 278 

- .179 
. 269 
. 046 
. 759 
. 201 


IQ Gain-Mo. 
Z3 z 


-171 
. 224 
.219 
. 208 
. 034 
. 130 
. 106 
. 105 
. 345 
-181 
. 125 
-121 
. 166 
. 106 
. 169 
. 241 
. 247 
. 180 
. 136 
.147 
. 151 
.118 
-112 
. 202 
. 364 
. 201 
. 166 
. 346 
. 094 


BORO FOr rts GOP RO NO CO ROPE me mee RO pt ree BO rt BOs BO et 


and sigmas were taken from the distribution 
of scores furnished by the authors and man- 
uals for the standardized tests. A summary 
list of tests administered is given in Tables I 
and II. A copy of each of the tests is to be 
found in Appendix ITI.* 

In developing the pupil gain criterion, all 
achievement tests were mailed to the prin- 
cipal and were either administered by him 
or by the teacher under his supervision and 
returned to the Teacher Personnel Research 
Committee for scoring. To insure accuracy, 
one out of every five tests was re-checked. In 
arriving at the criterion of residual pupil gain, 
the mean raw score gains were first computed 
by subtracting the mean of the classes on the 
pre-test from the mean of the classes on the 
post-test. Using the mean and standard devia- 
tion of the raw scores for the classes, the 
standard scores (z-scores) were calculated. 

To insure groups of equal ability, the 
Henmon-—Nelson Test of Mental Ability was 
administered to all pupils. Instead of match- 


* See or'g’nal report on file, Library, University of Wisconsin. 





September, 1946 | PREDICTION OF TEACHING EFFICIENCY 89 


ing groups in the conventional manner, the 
regression technique was used to predict pupil 
gain from factors other than teaching effi- 
ciency. This was done by calculating the 
zero-order coefficients of correlation between 
the z-scores of the pre-test, gain, mental abil- 
ity, and intelligence quotient. The Aitkin 
Modified Method With Each Pivot Converted 
to Unity’ was employed to solve the matrix 
thus secured (Table III). The equation for 
predicting pupil gain in terms of z-scores is: 
Z, == .0812, — .0602, + .0212, 


Gain 
z Scores 


Gain* 


Predicted Residual 


where z, = predicted gain, z, = pre-test, 
2 == mental age, and 2, — intelligence quo- 
tient. 

Using this equation, the predicted gain for 
each class was calculated and the criterion of 
teaching efficiency was obtained by subtract- 
ing this predicted z-score gain from the actual 
z-score gain thus arriving at a residual gain 
as shown in Table III. In those cases where 
the teacher had more than one class in which 
the standardized tests were administered, the 
z-scores of the pre-test, gain, mental ability, 
and intelligence quotient were combined and 
the mean z-score used in computation of the 
predicted gain. These residual gain scores rep- 
resent the gains attributable to the 33 teach- 
ers and to other unmeasured factors. 


This method of developing the pupil gain 
criterion assumed that the teachers are 
equally efficient regardless of the subject area 
in which they teach; that is, English teachers 
as a group were assumed to be as efficient as 
those for history and biology. This assump- 
tion is, of course, subject to criticism; hence, 
a second method of arriving at a residual gain 
score was used. Instead of using the actual 
mean and sigma of each class for conversion 
to z-scores, the mean and sigma were taken 
from the distribution of scores published by 
the authors of the achievement test admin- 
istered. In some cases the raw scores were 
converted to scale scores and z-scores calcu- 
lated directly using the mean and sigma for 
the particular class level involved. In the re- 
mainder of the cases where the test authors 
supplied percentile distributions, the raw 
scores were reduced to percentiles and then to 
z-scores by use of a conversion table.? The 


1 Godfrey H. Thomson, The Factorial Analysis of Human 
Ability (New York: Houghton Mifflin Co., 1939), pp. 89-95. 

2E. B. Green, Measurement of Human Behavior (New 
York: Odyssey Press, 1941), p. 60. 
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DEVELOPMENT OF RESIDUAL GAIN ScorEs For ENGLISH CLASSES 


2— 44523 


of lack of Henmon-Nelson IQ Scores, Case 33 was omitted. 


1—. 8942 


number 

3 

x 
14 
16 
22 
23 
28 
29 
33 
45 
47 
52 
59 
61 


*Zo = .4852 
** Because « 
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development of the residual gain using this 
method is presented in Table IV. The predic- 
tive gain formula is: 

2, == —.0892, + 6692, — 5602, 


where z, == predicted gain, z, — pre-test, 
3, == mental age, and z, = intelligence quo- 
tient. 

Since the largest single subject area in 
which tests were administered was English 
(14 cases), the criterion of pupil gain was 
developed for this group independently of all 
other classes. The predictive gain formula is: 


2, == .4852, — 8942, — .4452, 


where z, == predicted gain, z, — pre-test, 
z, == Henmon-—Nelson Test of Mental Abil- 
ity, z, == intelligence quotient (Table V). 


The response from the teachers and prin- 
cipals in whose classes achievement tests were 
administered was most gratifying. Two thou- 
sand four hundred fifty-four pupils were given 
the pre-test in 83 classes and approximately 
three months later post-tests were adminis- 
tered to the same pupils yielding usable gain 
scores for 1601 pupils (Tables I and IT). 


SECTION III 
ANALYSIS OF DATA 


The data for predicting the teaching suc- 
cess of the 65 persons participating in this 
study were as follows: 

t. Rank in high-school graduating class. 

2. University grade point average. 

a. Freshman. 

b. Sophomore. 

c. Junior. 

d. Senior. 

e. Combined Freshman-Sophomore. 
f. Combined Junior—Senior. 

g. Mean grade point for four years. 
h. Final grade in Education 73. 

i. Final grade in Education 74: 

j. Final grade in Education 75. 
k. Final grade educational methods. 
1. Student teaching grade. 


3- Henmon—Nelson Test of Mental Ability 
(college norms). 
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. American Council on Education Cooper- 
ative General Culture Test. 

5. American Council on Education Cooper- 
ativeReading Test, C2. 

6. The Bell Adjustment Inventory. 

7. The Link Inventory of Activities and 
Interests. 

8. American Council on Education Psycho- 

logical Examination for College Fresh- 

men. 


Two criteria of teaching efficiency as has 
already been said were used: (1) A com- 
posite of supervisory ratings made with the 
use of the Wisconsin Adaption, “M” Blank 
and (2) residual pupil gain. The relationships 
between these measures and other data are 
treated in the order listed. 


After the reduction of the data to score 
form, zero-order coefficients of correlation 
were computed between the measures and the 
criteria. These coefficients of correlation be- 
tween the various measures relative to each 
teacher, the number of cases on which the 
correlation is based, and the per cent signifi- 
cance level of correlation are presented in 
Table VI. It will be noted that these correla- 
tions are not all based on the same number of 
cases. This variation in the number of cases 
arises from a lack of complete data for some 
teachers. 

The coefficients of correlation between the 
Link Inventory of Activities and Interests 
and mean grade for Education 73, 74, 75, and 
the criterion of supervisory ratings are sig- 
nificantly different than zero at the five per 
cent level. The coefficients of correlation be- 
tween the combined Freshman—Sophomore 
grade point average, and the combined four 
year grade point averages were found to be 
significantly different than zero at approxi- 
mately the ten per cent level. All other coeffi- 
cients of correlation appear to indicate only 
chance relationships. The measures which 
appeared to be significantly correlated with 
the criterion; namely, the mean grade Edu- 
cation 73, 74, 75, the Link Inventory of 
Activities and Interests, and the combined 
four year grade point average, were placed in 
a correlation matrix and solved by use of 
Aitken’s Modified Method of Pivotal Conden- 
sation. 
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TABLE VII 
INTERCORRELATIONS AMONG THREE VARIABLES AND THE CRITERION OF SUPERVISORY RATING 


X» “M” Blank é 
X, Mean Gr. Ed. 73, 74, 75 
X, Link Inventory 

X; Combined 4 yr. GPA 


The resulting regression equation is: 
Z. == .23128, + .2562, + .0892, 


This yields a multiple correlation of .453, 
which is significant at the 18 per cent level. 


In further exploring the possibilities of 
inter-relations, the zero-order of coefficients 
of correlation between the Link Inventory of 
Activities and Interests, mean grade Educa- 
tion 73, 74, 75, rank in high school class, and 
the Henmon-Nelson Test of Mental Ability, 
with the criterion were placed in the correla- 
tion matrix and solved. 


Xo X; X> 


1. 000 . 398 
1. 000 

. 437 

. 616 


The resulting regression equation is: 
2, == —.1018, + .1782, — .1852, + .1412, 


The multiple R was found to be .264, which 
does not differ from zero by an amount that 
is statistically significant. 

The coefficients of correlation between the 
independent variables are in many instances 
interesting. Those which were found to be 
significant at the five per cent level or below 
were: 


1. Combined Freshman—Sophomore 
grade point average and combined 


Junior—Senior grade point average 598 


TABLE VIII 
INTERCORRELATIONS AMONG FOUR VARIABLES AND THE CRITERION OF SUPERVISORY RATING 


x = ——— 

X, Link Inventory. 

X. Mean Gr. Ed. 73, 74, 75 
X, High-school rank 

X , Henmon-Nelson 


The regression equation using these factors is: 
Zo == .2292, + .4782, — .2462, — .0272, 
The multiple correlation for this combination 
of measures is .487 which is significant at the 

14 per cent level. 

In addition to the above, the intercorrela- 
tions between student teaching grade, com- 
bined grade point average for four years, 
Cooperative General Culture Test, and Coop- 
erative Reading Test were calculated and 
placed with the criteria in a_ correlation 
matrix. 


Xo X; X: Xs; X« 
1. 000 
. 360 
. 398 
. 132 
115 


. 132 -115 
. 301 . 125 
. 676 . 491 
1. 000 - 491 
. 491 . 000 


. 398 
. 437 
1. 000 
. 676 
. 491 


. 360 
1. 000 
. 437 
. 301 
. 125 


. Combined Freshman-—Sophomore 
grade point average and mean 
grade Education 73, 74, 75 

. Combined Freshman—Sophomore 
grade point average and rank in 
ef a ae 

. Combined Freshman—Sophomore 
grade point average and four year 
grade point average 

. Combined Freshman—Sophomore 
grade point average and General 
Culture Test 


TABLE IX 


INTERCORRELATIONS AMONG FouR VARIABLES AND THE CRITERION OF SUPERVISORY RATING 


Xo “M” Blank. 

X , Student Teaching Gr. - 
X. Combined 4 yr. GPA 
X, General Culture. 

X , Reading Comprehension 


Xo X; X : X; X4 
1. 000 
. 041 
. 238 
—. 034 
-118 


.118 
—.118 
. 732 
. 893 
1.000 


. 238 
. 298 
. 000 
. 069 
. 732 


—. 034 
—.131 
. 069 
1.000 
. 893 


. 041 
1.000 
. 298 
—.131 
—.118 
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6. Combined Freshman—Sophomore 28. General Culture Test and Read- 


grade point average and psycho- 
logical examination 

. Combined Junior-Senior grade 
point average and final grade Ed- 
ucational methods (major) 

. Combined Junior—Senior grade 
point average and mean grade 
Education 73, 74, 75 

. Combined Junior-Senior grade 
point average and rank in high 
school class 

. Combined Junior-Senior grade 
point average and student teach- 
ing grade 

. Combined Junior-Senior grade 
point average and combined four 
year grade point average 

. Bell Adjustment and Link Inven- 
tory 

. Bell Adjustment and rank in high 
school class 

. Bell Adjustment and combined 
four year grade point average--_- 
. Link Inventory and mean grade 
Education 73, 74, 75 

. Link Inventory and rank in high 
school class 

. Link Inventory and General Cul- 
ture Test 

. Final grade educational methods 
and student teaching grade 

. Mean grade Education 73, 74, 75 
and rank in high school class_-_-- 
. Mean grade Education 73, 74, 75 
and combined four year grade 
point average 

. Mean grade Education 73, 74, 75 
and the Henmon—Nelson Test of 
Mental Ability 

. Rank in high school class and 
combined four year grade point 
average 

. Rank in high school class and 
General Culture Test 


24. Rank in high school class and 


Reading Comprehension Test --- 
. Rank in high school class and 
psychological examination 

. Rank in high school class and 
Henmon-Nelson Test of Mental 


. Combined four year grade point 
average and Reading Comprehen- 
sion Test 


336 


455 


491 


511 
.698 


-933 
.488 


491 


ing Comprehension Test 

29. General Culture Test and psycho- 
logical examination 

30. General Culture Test and Hen- 
mon-—Nelson Test of Mental Abil- 
ity 

31. The Reading Comprehension Test 
and psychological examination --_-_ 

32. The Reading Comprehension Test 
and Henmon-Nelson Test of 
Mental Ability 

33. The psychological examination 
and the Henmon-Nelson Test of 
Mental Ability 


The intercorrelations between all measures 
were then placed in a correlation matrix 
(Table X), with the criterion of supervisory 
rating, and solved by using Aitkin’s Modified 
Method of Pivotal Condensation. The result- 
ing beta coefficients are presented in Table 
XI. The regression equation for twelve of 
these measures yielded a multiple correlation 
of .670. The equation for these items is: 


Z) == .0832, — .188z, + .4922, + .6542, 
+ .6972, + .499%, — .3642, — .7272, 
+ .1952, — .4052,, + .2892,, — .0102,, 


When the variables z,, 2,, z,, and z, are 
considered with the criterion, the multiple 
correlation is .474 (Table XI). When z., z,, 
and z,, are added, the multiple correlation is 
increased to .564. This correlation is signifi- 
cantly different from zero at the five per cent 
level’ and is derived from the regression 
equation: 


Zo = .0052, + .157Z, + .0342, + .0912,, 
+ 4272, — .0432, — .1562,, 


The fact that the additional variables em- 
ployed in prediction actually lowered the 
multiple correlation, is due to the extremely 
low level of significance which exists between 
some of the factors. No measures were found 
to correlate significantly at the one per cent 
level. 

Attention is directed next to the correla- 
tions between the several measures and the 
criterion of pupil gains. These correlations are 


3 The significance of the multiple correlations is measured by 
the percent significance level as determined by the equation: 
Sig. level = 1 — 2 (area under normal probability curve at 

R 


1 
VN—a 
where a equals one more than the number of independent 
variables. 
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TABLE XII 
INTERCORRELATIONS AMONG THREE VARIABLES AND THE CRITERION OF PUPIL GAIN 


Pupil Gain - 
Xo Pel | Adj. (Part B)_ 


X; 
X, Bell Adj. (Total) - SP er Red 
X, Mean Gr. 73, 74, Re ee, 


Xo X ; Xs X; 

—- ae —. 186 —. 272 . 258 
. —. 186 . . 548 —.273 
— ‘ 1. 000 —. 030 
—. 030 1. 000 


TABLE XIII 


Zero ORDER COEFFICIENTS OF CORRELATION BETWEEN PUPIL GAIN CRITERION II 
AND THE INDEPENDENT VARIABLES 


Variables 
Combined 4 yr. GPA_-_-. 
Stud. Teaching Grade 
Final Gr. Ed. Meth.__-- 
CS a 
Am. Coun. Payee............. 
Hen.-Nels. Test__._--_ _- 
Bell Adj. (tot 1) - 
High-School Rank. 
General Culture____- , 
Mean Gr. Ed. 73, 74, 75-_ _ - 
Link Inventory _. Pe aaa 


reproduced in Table XIII. The correlations 
are uniformly low; none are significant at the 
one per cent level. 

The intercorrelations between the Bell 
Adjustment Inventory (Part B), Bell Adjust- 
ment Inventory (Total), and mean grade 
Education 73, 74, 75, and the pupil gain cri- 
terion when placed in the matrix (Table XII) 
and solved yielded a multiple R of .371. The 
regression equation for these measures is as 
follows: 


2) == .0432, — .2882, + .2612, 


Because of the evident lack of relationship 
between pupil gain criterion and other meas- 
ures, an attempt was made to refine the 
method of developing the pupil gain criterion. 
In developing the new criterion, the means 
and sigmas were taken from the published 
achievement test norms instead of from the 
samples here studied. New z scores were cal- 
culated and a new prediction equation devel- 
oped (Section II, Table IV). Using the re- 
sidual gain developed in this manner, coeffi- 


Cri. I Cri. II 
r 


—. 118 
—. 276 
—. 025 
—. 022 
. 046 
- 128 
—.141 
—. 482 
—. 194 
. 060 
. 094 


cients of correlation were calculated between 
criterion II and the independent variables. 
These correlations, along with those for cri- 
terion I, are presented in Table XIII. Little 
improvement will be noted in the correlations 
with the new criterion except between the cri- 
terion and rank in high school class. (—.482 
as compared with —.225). This correlation is 
negative as would be expected since the 
highest ranks were given the smallest numeri- 
cal values. 


The intercorrelations between rank in high- 
school class, General Culture Test, and Bell 
Adjustment Inventory, were arranged in a 
matrix with pupil gain criterion IT and solved. 
The regression equation for this is: 


2, == —.7822, + .3382, + .1652, 


The multiple R — .537, and was found to be 
slightly higher than the multiple R of .371 
when pupil gain criterion I was used. The 
matrix containing these intercorrelations are 
presented in Table XIV. 


TABLE XIV 
INTERCORRELATIONS AMONG FouR VARIABLES AND PUPIL GAIN CRITERION II 


X 


> Pupil Gain IT. __-..__- 
X 
xX 
X; 


Bell Adjustment. 


Xo X, Xs X; 

1. 000 —. 482 —. 194 —.141 
—. 553 1. 000 . 698 . 393 
—. 194 . 698 1. 000 . 085 
—.141 . 393 . 085 1. 000 





96 JOURNAL OF EXPERIMENTAL EDUCATION [Vol. 15, No.1 


TABLE XV 


ZERO ORDER COEFFICIENTS OF CORRELATION BETWEEN PUPIL GAIN CRITERION For ENGLISH 
GROUP AND THE INDEPENDENT VARIABLES 
Variable } % Sig. 
See megee SP A. . . — : raise 
Junior-Senior GPA. : 
Bell Adjustment Total _ 
Link Inventory - 
Final Grade Ed. Meth._ 
Mean Gr. Ed. 73, 74, 75_ 
High-School Rank 
Student Teaching Grade_____ _ - 
Combined 4 yr. GPA___- 
General Culture Test _ 
Reading Comprehension _- 
Amer. Counci 
Henmon-Nelson Test. _ __- 


— 3 2« wn Ww © «2 


TABLE XVI 
ZERO ORDER COEFFICIENTS OF CORRELATION BETWEEN PRE-TEST AND GAIN SCORES 


r r 
No. of between No. of between 
Teacher pupils Min.r* Teacher i pre-test Min.r 
No. tested i No. tested and gain 
. 487 41 . 236 
. 448 42 —, 232 
43 


45 


46 
47 


48 
11 . , 

12 _—. ‘ 49 

; 50 

—. : 51 

13 . ‘ 52 
14 
18 


19 
23 


1 
3 
4 
5 
6 


7 
8 


24 
28 


29 


31 
36 


. 933 


* Size of r necessary for significance from 0 at the 1% level. 
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The largest single area in which achieve- 
ment tests were administered was that of 
English (14 cases). Each of the classes in this 
area were given two tests: (1) Test A: Me- 
chanics of Expression and (2) Test Br: 
Effectiveness of Expression. 


To further develop the pupil gain criterion, 
the residual gain scores for the English group 
were computed independently from those of 
other subject groups. When the mean and 
sigma for the group are used for computing 
z-scores as for criterion I above, the pre-test 
scores, mental age, and intelligence quotient 
when used in predicting the gain, gave a 
multiple R of .807. The regression equation 
is: 

2, = .4852, — .8942. — .4452, 


Using the residual pupil gain scores for the 
English classes, zero-order coefficients of cor- 
relation were calculated between the other 
independent variables (Table XV). 


Of these correlations, only two were found 
to be significant; General Culture Test 
(—.583 at the five per cent level) and the 
Reading Comprehension Test (—.685 at the 
one per cent level). Because of the smallness 
of the number of cases, no multiple R was 
calculated. It would seem however, that this 
correlation would probably be much higher 
than that from a mixture of classes. 


Previous investigators*:* have frequently 
referred to the negative correlations between 
pupil gain and pre-test scores. The scores in 
this investigation between pupil gains and 
pre-test scores follow the usual pattern. A 
summary of these data is presented in Table 
XVI. For the total of 67 coefficients of cor- 
relation thus obtained, 48 were found to be 
negative ranging from —.004 to —.933. For 
the 19 positive coefficients of correlation, the 
range was from .o12 to .645. 


When the coefficients of correlation be- 
tween pre-test and gain scores are ranged 
according to subject areas, the results pre- 
sented in Table XVII are obtained. In the 
28 English classes tested, the coefficients of 
correlation between pre-test and gain scores 
ranged from —.777 to .328. Twenty-five of 
the correlations were negative and three 
positive. 


*C. W. LaDuke, “The Measurement of Teaching Ability,” 
favest of Experimental Education, XIV (September, 1946), 
75-100 


100. 
5 Leon E. Rostker, ““The Measurement of Teaching Ability,”’ 
Journal of Experimental Education, XIV (September, 1945). 
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For the five Art classes tested, the correla- 
tions, all of which were negative, ranged from 
—.047 to —.387. 

In the area of Civic Beliefs, coefficients of 
correlation between pre-test and gain scores 
were also found to be negative for the four 
classes tested, ranging from —.028 to —.447. 

For Latin, three of the five coefficients of 
correlation were negative and ranged from 
—.232 to —.463. The two positive coefficients 
of correlation were .co9 and .064. 

Coefficients of correlation between pre-test 
and gain scores for the four Spanish classes 
ranged from —.136 to .645, two being nega- 
tive and two being positive. 

The subject areas in which three or less 
classes were tested, taken as a whole, show a 
similar distribution of negative and positive 
coefficients of correlation. The negative cor- 
relations doubtless arise in part from the 
tendency of teachers to spend more time with 
slower pupils than with brighter ones. 

Finally, attention is called to the lack of 
agreement between the criteria of supervisory 
ratings and pupil gain. The intercorrelations 
are presented in Table XIII. The findings 
here reported are in keeping with those of 
other investigators.°® 


SUMMARY AND CONCLUSIONS 


The central purpose of the study reported 
in this section has been to determine the accu- 
racy with which prediction of teaching effi- 
ciency can be made in terms of the data col- 
lectable during the time of university prepa- 
ration. 

As has been said, two criteria of efficiency 
were employed: (1) supervisory rating 
through the use of the Wisconsin Adaptation, 
“M” Blank, and (2) residual pupil gain. The 
criterion of pupil gain was first developed by 
using the means and sigmas of the distribu- 
tion of scores for each of several subject areas. 
Later, inasmuch as this method assumed that 
all teachers, regardless of the subjects that 
they were teaching, were equally efficient, the 
residual gain scores were calculated through 
the use of the means and sigmas taken from 
the published achievement test norms. 

On the basis of the data presented it would 
appear that: 

(1) The criteria of teaching efficiency em- 
ployed are not related to a greater degree than 


*A. S. Barr and others, The Measurement of Teaching Abil- 
ity (Madison. Wisconsin: Dembar Publications, Inc., 1945). 

L. Joseph Lins, Prediction of Teaching Efficiency, first re- 
port published herein. 
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TABLE XVII 


ZERO ORDER COEFFICIENTS OF CORRELATION BETWEEN PRE-TEST AND GAIN ScoREs ACCORDING 
To SuBJEcT AREAS TAUGHT 


Teacher Min.r* 


No. 
3 Eng. A 
Eng. B1 
8 Eng. A 
Eng. B1 
14 Eng. A 
Eng. B1 
16 Eng. A 
Eng. 
22 Eng. 
Eng. 
23 Eng. A 
Eng. 
28 Eng. 523 
Eng. 419 
29 , .012 
047 
33 576 
758 
45 060 
004 
47 456 
52 
59 
61 


Subject r 


. 448 
. 452 
. 587 
. 549 
. 498 
. 487 
. 549 


—.310 
585 
777 
466 
459 
472 


394 
327 
444 
334 
515 


PIIIIII INI] 


578 
. 052 
. 096 
. 223 
. 328 
311 


bhtddgd 


I 


J1)))] 


Pl. Geom. 071 


6 Algebra 
41 . 236 


4 
5 
31 
51 
62 
6 


. 452 


Teacher Subject r Min.r 
No. 

. 319 . 549 

—. 933 . 436 

—.134 . 549 


Geog. . 123 . 442 
. 097 . 487 


. 892 . 450 


Social Studies —.233 . 292 
- 105 . 480 
. 242 . 496 


. 387 . 450 
. 028 . 360 
- 430 . 561 
. 447 - 536 


General Science .173 
. 020 


-414 
. 473 
. 038 


- 463 
- 009 
. 232 
. 064 
. 343 


Amer. Hist. 


Civic Beliefs 


World Hist. 


Latin 


Spanish ; 
. 136 
. 645 
. 185 
Biology . 611 


Music 


Chem. -196 


* Size of r necessary for significance from zero at the 1% level. 


TaBLeE XVIII 
ZeERO-ORDER COEFFICIENTS OF CORRELATION BETWEEN THE CRITERIA 


Criterion 
“*M” Blank with pupil gain I___- 
“‘M” Blank with pupil gain IT__- 
Pupil gain I with pupil gain II 
Pupil gain for English and “‘M” Bl 
Pupil gain for English and pupil gain I 


is attributable to chance. Whatever pupil gain 
measures in relation to teaching ability it is 
not that emphasized in supervisory ratings. 
(2) The coefficients of correlations between 
the several variables and criteria found in this 
investigation, were somewhat lower than those 


found by Lins’ and Von Haden.* The highest 

multiple R for the criterion of supervisory 

ratings was .67; for pupil gain .537. The low 

TL. Joseph Lins, The Prediction of Teaching Efficiency, first 
ished. herein 


report ‘ 

® Herbert I. Von Haden, Am Evaluation of Certain Types of 
Personal Data in the iction of Teaching Efficiency, second 
report published herein. 
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correlations of this study may in part be due 
to the absence of subjective data such as 
those employed by Lins and Von Haden. The 
criterion of supervisory ratings, based upon 
the principals’ evaluation and the Wisconsin 
Adaptation, “M” Blank also appears less ade- 
quate than the criterion developed through 
the use of several ratings for each teacher, 
neither where the situations rated for diffi- 
culty as in the studies by Lins and Von 
Haden. 

(3) A combination of twelve variables with 
supervisory ratings gave a multiple R of .67. 
The use of (a) mean grade, Education 73, 74, 
and 75, (b) Link Inventory of Activities and 
Interests, and (c) rank in high-school class 
gave a multiple R of .487 which is significant 
at the 14 per cent level. 


(4) The rank in high-school class is the 
best single predictive measure of residual 
pupil gain. (7 == —.225 where group means 
and sigmas were used, and rf == —.482 in 
employing the means and sigmas published by 
the authors of the tests. The combined factors 
of the General Culture test, Bell Adjustment 
Inventory, and the rank in high-school class 
yielded a coefficient of multiple correlation of 
.371 with residual pupil gain I, and .537 with 
residual pupil gain II. 

(5) The development, independently, of 
the residual pupil gain criterion for the Eng- 
lish groups appears slightly more adequate 
than when they are with the whole group. 
This study was based upon the returns from 
14 subject areas and presents some evidence 
that a more intensive study of fewer subject 
areas would result in coefficients of correlation 
at a higher level of confidence. 


(6) The coefficients of correlation between 
the independent variables and the criterion of 
supervisory ratings were at a slightly higher 
level of significance than those with the cri- 
terion of residual pupil gain. Von Haden 
secured a similar result. 


7. That teachers have a tendency to spend 
more time and effort in giving instruction to 
the slower pupils would seem to be reflected 
in the distribution of negative coefficients of 
correlation between pre-test and gain scores. 
Nearly 72 per cent of these coefficients of 
correlation were negative. Although the use of 
the regression technique is thought to correct 
for this negative array, there is evidence of 
the need for further refinement and control in 
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the development of residual gain scores. 
Standardization of the procedure of admin- 
istering the achievement tests in the various 
schools might also contribute to more valid 
and reliable data. 


SUMMARY AND COMMENTS 


A. S. Barr 
University of Wisconsin 


It will not be our purpose to repeat here 
the detailed summaries of the investigations 
presented earlier in this report. For these 
summaries the reader is referred to the papers 
themselves. Instead we shall discuss some of 
the more general features of these investiga- 
tions with suggestions for further efforts in 
this area. 

Three criteria have been employed in the 
investigations here reported, namely, (1) 
supervisory ratings, (2) pupil evaluations of 
teachers, and (3) residual pupil gains. Each 
criterion was developed with care. As has 
been repeatedly pointed out,’ the criterion 
by which teaching success is evaluated is of 
prime importance. Many of the investigations 
in this area have suffered from lack of an 
adequate criterion. One of the very ap- 
parent results of the studies here reported, 
however, is to call attention again to the 
lack of agreement among the criteria com- 
monly employed in the evaluation of teaching 
efficiency. Whatever supervisors look for it is 
not that considered of prime importance by 
pupils in their evaluation. of teachers or that 
measured by tests of pupil achievement. 

It is probably unnecessary to emphasize the 
fact that the teacher is not merely a director 
of learning but a friend and counselor of stu- 
dents, a member of a school staff that must 
work as a unit in performing the many com- 
plex activities of the modern school and a 
part of a school community as well. While 
these various aspects of teaching were given 
consideration in the investigations here re- 
ported, further effort needs to be expended 
in this direction. 

In a sense, Jones’ study is the most inter- 
esting of the studies here reported. The writer 
has repeatedly contended that teaching effi- 
ciency can be measured and predicted when 
the measurements are reasonably complete, 
valid, and reliable, and checked against an 


1A. S. Barr and others, The Measurement of Teaching Abil- 
ity (Madison, Wisconsin: Dembar Publications, Inc., 1945). 
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adequate criterion. Jones’ study differs from 
those of Lins’ and Von Haden’s in two im- 
portant respects. In the first place the meas- 
ures used by Jones are less comprehensive in 
character. Both Lins and Von Haden used in 
addition to the objective data reported by 
them a very large amount of subjective data. 
These subjective data doubtless covered abil- 
ities not covered by the now available tests 
in this area. Then, too, Jones’ criteria were 
not as well developed as those of Lins and 
Von Haden. This arose from no fault of Jones 
but from the plan of the investigation as sug- 
gested by his advisors; For one of his criteria 
Jones relied, as is frequently the case, upon 
a single supervisory rating; Lins and Von 
Haden employed a composite of five ratings. 
While this subject did not here come under 
specific investigation, there seems to be some 
evidence from other sources to indicate that 
ratings tend to stabilize themselves as more 
ratings are added to composites. The second 
of Jones’ criteria, namely that of pupil gain, 
was equally inadequate. His measures of pupil 
progress in addition to the lack of complete- 
ness, from which most of the studies in this 
area suffer, were drawn from a variety of 
school subjects with very few cases in each 
category. Certain assumptions were then nec- 
essarily made in treating these data that 
doubtless lessened their validity. He very ob- 
viously secured better results from a single 
homogeneous group as shown by his study of 
teachers of English. While the studies by Lins 
and Van Haden suffer from the same lacks, 
the number of subject areas studied was not 
as great as in Jones’ study, and the number 
of cases larger. The findings in Jones’ study 
are accordingly nearly in accord with those 
so frequently reported in the literature with 
inadequate controls, measures, and criteria. 
In all other respects, the three studies fol- 
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lowed a like pattern with similar data 
like statistical procedures. 

All in all, it seems clear from the data hey 
reported, that interviews, autobiographies, ang 
subjective evaluations add something of i 
portance to studies in the measurement a 
prediction of teaching efficiency. While they 
possess greater predictive value for the crite 
rion of supervisory ratings they also possess” 
predictive value for the criterion of pupils” 
gains as shown by Lins’ study. The area left” 
to subjective evaluation will doubtless become 
somewhat more restricted with the devel 
ment of new and improved measures of teal 
ing efficiency, but the aspects of teaching ef- 7 
ficiency covered by subjective ratings will 7 
doubtless continue to be extensive for some 
time to come. With this thought in mind, more | 
attention should probably be given to sub- 
jective rating. While the means of objectify- 
ing subjective ratings employed by Von Haden 
failed to give improved results it would seem 
that the situation might be somewhat im- 
proved through careful definition of the as 
pects of teaching to be evaluated, through the © 
careful selection and training of judges, and 
through the use of two, three, or more judges. © 
This latter recommendation should and will 
be subjected to careful investigation. 

The studies here reported have proceeded 
on the same assumption as that of earlier in- — 
vestigations,? namely, that teaching is a very © 
complex activity, and its various components 
must be adequately sampled and adequately © 
measured to secure satisfactory results. A 
careful application of what is known in this 
area should give results better than those yet © 
achieved in the measurement and prediction 
of teaching efficiency. 


*W. H. Lancelot and others, The — of Teaching 
* wate, (New York: The Macmillan Co., 1935). 

S. Barr and others, Tas Blosmmamen’ of Feasting Ati 

a ‘(idedinns, Wisconsin: Dembar Publications, Inc., 1945). 








